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Abstract 

This  study  examined  the  variability  experienced  in  the  administrative  and 
production  lead  times  of  consumable  items  managed  by  the  Defense  Logistics  Agency 
(DLA).  Assets  were  categorized  based  on  an  item  manager’s  determination  that  an  asset 
was  a  problem  part,  and  whether  the  asset  was  purchased  for  stock  replenishment  or 
direct  vendor  delivery.  The  methodology  was  a  two-sample  t-test  of  aggregated  data  to 
determine  if  sigmficant  differences  existed  between  the  mean  deviations  from  the  system 
lead  times  of  various  combinations  of  categories.  The  study  produced  residts  indicating 
that  a  significant  difference  did  not  exist  between  the  mean  deviations  of  problem  parts 
and  non-problem  parts,  but  substantial  variability  did  exist  for  all  categories  of 
consumable  items.  The  degree  of  variability  was  such  that  the  author  suspected  this  as  a 
possible  cause  for  individual  assets  entering  problem  part  status.  The  study  also 
confirmed  that  while  the  DLA  methodology  used  for  forecasting  lead  times  of  stock 
replenishment  purchases  was  accurate  over  aggregated  data,  the  variability  present  is,  to 
some  extent,  contributing  to  excess  inventory  levels. 
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A  STATISTICAL  ANALYSIS  OF  THE  VARIABILITY  EXPERIENCED 


IN  DLA  ADMINISTRATIVE  AND  PRODUCTION  LEAD  TIME 


I.  Background  and  Problem  Presentation 


Introduction 

By  nature,  maintenance,  repair,  and  overhaul  environments  such  as  Air  Force 
depots  experience  unpredictable  demand  patterns.  That  is,  repair  facilities  can  not  know 
which  components  of  a  particular  end  item  have  failed  imtil  the  end  item  is  disassembled 
and  inspected.  This  varying  demand  often  causes  work  stoppages  due  to  lack  of 
component  parts.  The  impact  of  such  work  stoppages  on  Air  Force  readiness,  though  yet 
to  be  measured,  is  considered  to  be  significant.  For  this  reason,  significant  research  and 
operational  effort  has  been  expended  in  the  area  of  inventory  management  and 
requirements  computations  in  examining  the  issue  of  demand  forecasting.  The  systems 
used  for  these  activities,  however,  frequently  rely  on  many  variables,  some  of  which 
experience  considerable  variability.  This  study  examines  the  variability  in  forecast  errors 
for  consumable  items  managed  by  the  Defense  Logistics  Agency  (DLA). 
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Problem  Statement 


The  relationship  between  the  readiness  of  Air  Force  weapon  systems  and 
reparable  end-items  has  received  much  attention  in  recent  years.  By  extension,  weapon 
system  readiness  is  also  directly  related  to  the  effective  determination  of  requirements  for 
consumable  parts  used  to  repair  these  end-items.  The  Department  of  Defense  (DoD) 
relies  on  the  Wilson  Economic  Order  Quantity  (EOQ)  model  to  manage  consumable 
items  at  DLA,  and  at  all  echelons  in  the  Air  Force  logistics  chain.  EOQ  is  a  reorder  point 
system  that  attempts  to  compute  the  most  economical  order  size  by  balancing  ordering 
cost  and  holding  cost.  It  is  a  deterministic  model  in  that  all  of  the  parameters,  including 
lead-time,  are  assumed  to  be  known  or  can  be  calculated  with  certainty  (Tersine,  1994: 
91).  Of  the  many  parameters  used  in  inventory  management  and  requirements 
forecasting,  arguably,  the  two  most  critical  are  demand  and  lead-time.  The  issue  of 
demand  forecasting  continues  to  receive  well-deserved  attention.  The  lead  time  of 
consumable  items,  on  the  other  hand,  appears  to  take  second  billing  in  terms  of  academic 
and  operational  research.  This  study  focuses  on  the  impact  of  lead  time  variability. 

Procedurally,  DLA  uses  a  weighted  average  of  the  lead  times  of  the  previous  two 
purchases  to  determine  the  forecast  for  the  next  purchase.  In  the  parlance  of  DLA,  this 
forecast  is  termed  "system"  lead  time,  or  "lead  time  of  record."  The  specifics  of  the  lead 
time  methodology  are  discussed  further  in  Chapter  11.  These  lead-times,  which  may  be 
frequently  violated  in  the  real-world  acquisitions  environment,  are  the  focus  of  this 
research  effort.  There  are  two  specific  management  questions  addressed  in  this  study. 
First,  are  inaccurate  system  lead  times  a  contributing  factor  in  the  classification  of  parts 
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as  problem  items  or  the  accumulation  of  excess  inventory,  and  second,  are  the  system 
lead  times  utilized  by  inventory  management  programs  accurate  approximations  of  actual 
lead  times  ejqierienced  in  the  acquisitions  process? 

Specifically,  this  study  focuses  on  consumable  parts  used  in  the  FlOO-GE-1 10  and 
FlOO-GE-129  engines.  The  FlOO-1 10  engine  was  chosen  based  on  the  fact  that  it  is  the 
primary  driver  of  F-16  mission  capable  rates  as  of  the  date  of  this  study  (Stevens,  1999). 


Research  Objectives 

The  main  purpose  of  this  study  is  to  examine  the  nature  and  accuracy  of  the  lead 
times  utilized  for  requirements  computations  by  DLA.  Chapter  II  establishes  a  need  for 
this  research  through  a  review  of  DoD  inventory  management  theory  and  practice.  The 
quantitative  nature  of  the  system  lead  times,  and  their  accuracy  based  on  actual 
contracting  actions  is  analyzed  in  Chapter  IV.  Chapter  IV  also  includes  aggregate 
statistical  analyses  of  various  categories  of  consumable  assets,  and  inferences  based  on 
the  descriptive  statistics. 

The  justification  and  foundation  for  this  research  is  demonstrated  through  a 
discussion  of  the  influence  of  lead  time  on  inventory  levels  based  on  current  DLA 
inventory  policy.  This  is  followed  with  a  thorough  review  of  reports  on  DoD  secondary 
item  management  issued  over  the  past  decade  by  organizations  such  as  the  General 
Accounting  Office  (GAO)  and  the  Logistics  Management  Institute.  Finally,  the  data 
must  be  analyzed  to  answer  the  research  questions  presented  below. 
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Research  Questions 


To  meet  the  research  objective  and  answer  the  management  questions,  particular 
research  questions  must  be  answered.  These  questions  are  listed  below. 

1 .  What  is  the  impact  of  lead-time  variability  on  consumable  item  inventory 
levels  in  the  DoD? 

2.  What  methodology  does  DLA  use  to  assign  lead  times  to  assets? 

3.  Is  there  a  difference  in  the  distributions  of  deviations  from  system  lead  times 
for  items  classified  as  problem  parts  versus  items  that  are  not  (Case  1)? 

4.  Is  there  a  difference  in  the  distributions  of  deviations  from  system  lead  times 
for  items  purchased  for  stock  replenishment  versus  direct  vendor  delivery 
(DVD)  contracts  (Case  2)? 

5.  Is  there  a  difference  in  the  distributions  of  deviations  from  system  lead  times 
for  problem  parts  bought  for  stock  replenishment  versus  problem  parts  under 
DVD  contracts  (Case  3)? 

6.  Is  there  a  difference  in  the  distributions  of  deviations  from  system  lead  times 
for  non-problem  parts  bought  for  stock  replenishment  versus  non-problem 
parts  under  DVD  contracts  (Case  4)? 

7.  Is  there  a  difference  in  the  distributions  of  deviations  from  system  lead  times 
for  problem  parts  bought  for  stock  replenishment  versus  non-problem  parts 
bought  for  stock  replenishment  (Case  5)? 
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8.  Is  there  a  difference  in  the  distributions  of  deviations  from  system  lead  times 
for  problem  parts  under  DVD  contracts  versus  non-problem  parts  imder  DVD 
contracts  (Case  6)? 


Hypothesis 

Thus,  this  study  examines  a  small  slice  of  consumable  items  to  determine  the 
accuracy  of  the  system  lead  times  used  by  DL  A  in  requirements  computations.  The 
overarching  hypothesis,  then,  is: 

Null  Hypothesis:  the  current  DLA  methodology  for  computing  system  lead  times 
for  requirements  computations  ensures  cost-effective  and  appropriate  inventory  levels. 

Alternate  Hypothesis:  the  cvirrent  DLA  methodology  for  computing  system  lead 
times  for  requirements  computations  does  not  ensure  cost-effective  and  appropriate 
inventory  levels. 

This  hypothesis  is  tested  through  statistical  analysis  of  historical  data. 
Additionally,  the  nature  of  lead  time  variability  is  explored  with  regard  to  various 
categorizations  of  consumable  items  in  order  to  determine  if  the  lead  times  of  certain 
categories  may  warrant  closer  management  attention.  Specific  hypotheses  regarding 
categorical  lead  times  are  formulated  in  Chapter  III. 
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Methodology 


The  approach  is  a  two-sample  t-test  to  determine  if  significant  differences  exist 
between  the  groups  tested  for  each  of  the  six  cases  outlined  above.  The  system  lead 
times  for  each  item  are  subtracted  from  their  actual  lead  times,  as  established  in  the  DLA 
Integrated  Data  Base,  and  a  two-sample  hypothesis  test  is  conducted  on  the  mean 
deviations.  The  DLA  Integrated  Data  Base  interfaces  with  the  Standard  Automated 
Materiel  Management  System  (SAMMS)  to  obtain  data  and  reports.  Appendix  G-2  in 
DLA  Manual  4140.2  defines  SAMMS  as: 

The  computer  system  which  is  used  to  process  transactions  of  the 
construction  supplies  Stock  Fund.  The  system  coimects  the  major 
directorates  at  [Defense  Supply  Centers]  and  provides  the  necessary  data 
for  management  of  the  Stock  Fund  inventory.  SAMMS  consists  of  five 
subsystems:  Distribution,  Requirements,  Contracting,  Technical  and 
Logistics,  and  Financial. 

There  are  four  categories  used  to  differentiate  the  items  in  the  sample.  The  first 
two,  problem  parts  and  non-problem  parts,  are  the  result  of  a  determination  by  an  asset's 
item  manager.  A  definition  of  "problem  part"  is  left  for  Chapter  III.  The  second  set  of 
categories  are  defined  by  type  of  purchase.  That  is,  whether  the  item  was  purchased  to 
replenish  DLA  stock  or  for  direct  delivery  by  the  vendor  to  the  user.  Research  questions 
three  and  four,  examine  the  first  two  categories.  Research  questions  five  through  eight 
examine  combinations  of  the  four  main  categories.  Questions  five  and  six  seek  to 
determine  if  a  difference  in  lead  time  exists  between  problem  parts  and  non-problem 
parts  in  the  two  categories  of  type  of  purchase.  Similarly,  research  questions  seven  and 
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eight  compare  the  type  of  purchase  across  problem  part  and  non-problem  part  categories. 
The  same  statistical  procedure  is  applied  to  all  tests. 


Assumptions 

The  assumptions  necessary  for  this  study  are  primarily  statistical  in  nature.  One 
assumption  that  applies  throughout  this  study  is  that  the  parts  used  for  sample  data  are 
representative  of  the  entire  population  of  DLA  managed  consumable  items  in  terms  of  the 
categories  used  for  analysis.  In  addition,  there  are  a  number  of  assumptions  related  to  the 
statistical  analysis  that  are  necessary  for  two-sample  hypothesis  testing.  These  are 
discussed  with  the  test  heuristic  in  Chapter  III. 

Additionally,  the  methodology  for  computing  the  average  system  lead  times  as 
discussed  in  Chapter  III  is  assumed  to  approximate  the  actual  system  lead  times  in 
SAMMS  for  specific  purchases  at  the  time  of  the  acquisition. 


Limitations  of  the  Research 

The  scope  of  this  study  is  restricted  to  DLA  managed  consumable  items  for  the 
FlOO-110  and  FlOO-129  engines.  Additionally,  as  the  Defense  Supply  Center  (DSC)  - 
Columbus  and  DSC  -  Richmond  manage  all  of  the  items  in  the  sample  data,  any  findings 
can  not  be  generalized  beyond  these  centers. 

There  are  two  specific  limitations  on  the  scope  of  this  study.  The  first  relates  to 
the  boundaries  of  the  data  and  is  driven  by  practicality.  Although  the  number  of  parts  in 
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the  sample  data  is  relatively  low  compared  to  the  vastness  of  the  DoD  inventory,  the  parts 
selected  resulted  in  over  a  ten-fold  increase  in  number  of  data  points  to  be  analyzed. 

The  second  limitation  is  a  function  of  the  methodology  employed  in  this  study. 
That  is,  for  analysis  purposes  the  data  are  aggregated  to  determine  if  findings  can  be 
generalized  to  a  category  of  parts.  As  a  result,  none  of  the  findings  can  be  applied  to 
individual  parts  used  in  the  sample  data. 


Organization  of  Research 

Chapter  II  begins  with  a  brief  synopsis  of  the  supply  terminology  found  in  this 
study.  This  is  followed  with  a  discussion  of  the  theory  behind  EOQ  and  the  variations 
that  DLA  applies  to  the  EOQ  model  in  determining  consumable  requirements.  With  this 
foundation  laid,  a  review  of  recent  literature  relating  to  DoD  inventory  management 
establishes  the  need  for  this  research.  The  literature  review  will  aid  in  formulating 
answers  to  the  management  questions  as  well  as  research  questions  one  and  two,  while 
the  statistical  analysis  will  answer  research  questions  three  through  eight. 

Chapter  III  explains  the  methodology  employed  to  analyze  lead  time  variability. 
It  begins  with  a  review  of  the  data  collection  process,  including  delineation  of  sample 
categories  and  defimtions  of  the  variables  used  for  categorization  and  statistical  analysis. 
The  core  of  the  chapter  is  the  heuristic  for  conducting  the  two  sample  hypothesis  tests. 

Chapter  IV  is  the  analysis  of  the  results  of  the  hypothesis  tests  conducted  for  this 
research.  Additionally,  observations  based  on  means  and  standard  deviations  of  the 
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categories  are  discussed.  A  summary  is  found  in  Chapter  V  along  with  general 
inferences  based  on  the  analysis  and  recommendations  for  areas  of  future  research. 
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II.  Literature  Review 


Introduction 

Although  the  focus  of  this  study  is  an  exploration  of  the  variability  experienced  in 
lead  times  for  DLA  assets  and  the  impact  of  that  variability  on  reqiurement  computations, 
it  is  necessary  for  this  chapter  to  begin  with  an  overview  of  inventory  management  within 
the  Department  of  Defense  (DoD).  This  widening  of  scope  to  the  DoD  is  necessary  as 
the  Defense  Logistics  Agency  (DLA)  manages  the  majority  of  DoD  consumable  items 
(Hanks,  1990: 1-3).  The  percentage  of  items  managed  by  DLA  has  further  increased  in 
recent  years  due  to  the  transfer  of  many  consumable  items  to  DLA.  As  a  result,  much  of 
the  literature  concerning  DoD  consumable  inventory  can  be  generalized  to  DLA. 

F ollowing  this  discussion,  the  relevant  methodology  employed  by  DLA  in  inventory 
management  is  explained  in  concert  with  the  role  of  lead  time  in  DLA  requirement 
computations.  Finally,  a  justification  for  further  analysis  of  lead  time  variability  is 
presented  through  numerous  General  Accounting  Office  (GAO)  reports  on  DoD 
inventory  management  and  by  directly  linking  consumable  items  to  the  readiness  of  Air 
Force  weapon  systems. 

Most  discussions  of  DoD  inventory  management  is  tend  to  overflow  with  rather 
unique  terminology.  Before  reviewing  the  pertinent  literature  on  this  subject,  an 
explanation  of  key  terms  found  within  this  research  effort  is  provided. 
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Explanation  of  Relevant  Terms 


This  section  provides  definitions  or  brief  explanations  of  supply  terms  found  in 
the  order  in  which  they  appear  in  this  study.  The  first  three  terms  are  technical  codes  for 
classifying  assets.  A  complete  definition  of  these  codes,  as  found  in  DLA  Manual 
4140.2,  Volume  II,  Part  1,  Appendix  G-2,  can  be  found  in  Appendix  A.  Although  these 
terms  may  be  commonplace  to  those  in  the  inventory  career  field,  they  are  provided  here 
for  the  purpose  of  easy  reference. 

Item  Category  Code  (ICC).  A  code  assigned  to  an  item  to  indicate  whether  it  is  to 
be  managed  as  a  replenishment  demand  type  or  a  numeric  stockage  objective. 

Supply  Status  Codes  (SSO.  A  series  of  codes  used  to  reflect,  in  materiel 
management  records  and  in  the  Federal  Cataloging  System,  decisions  made  by  inventory 
managers  as  to  the  normal  means-of-supply  stockage/nonstockage  status  of  each  assigned 
NSN. 

StandarHiTation  Status  Code  fSTDZ.  SSCV  Item  Standardization  Status  Codes 
denote  that  an  item  is  authorized  for  purchase  or  not  authorized  for  purchase,  and  where 
and  why  the  decision  was  made. 

Direct  Vendor  Delivery  (DVD).  DVD  is  an  improvement  initiative  whereby  DLA 
utilizes  long-term  contracts  and  electronic  data  interfaces  to  permit  suppliers  to  deliver 
directly  to  the  end  user  (GAO,  1997b:7).  In  a  statement  before  the  Senate  Subcommittee 
on  Readiness  and  Management  Support  on  17  March  1999,  Lieutenant  General  Henry 
Glisson  reported  that  one  of  DLA's  goals  in  corporate  contracting  was  to  use  DVD. 
Specifically,  he  stated,  "Where  feasible,  long-term  DVD  contracts  are  issued  for  the 
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vendor's  entire  catalog  of  applicable  parts  and  use  their  commercial  distribution  system  or 
network..."  (Glisson,  1999). 

Prime  Vendor.  Prime  vendor  is  a  term  for  a  single  vendor  that  stores  and 
distributes  assets  directly  to  customers.  The  relationship  is  marked  by  a  close  partnership 
between  the  supplier  and  customer  and  the  use  of  electronic  ordering  systems  (GAO, 
1997b:3). 

Integrated  Suppliers.  Integrated  suppliers  essentially  adopt  total  responsibility  for 
a  customer's  inventory  management  ftinction.  The  system  requires  an  on-site 
representative  of  the  supplier  to  order  and  replenish  assets.  The  assets  remain  in  the 
supplier's  warehouse,  and  are  delivered  on  a  just-in-time  concept  (GAO,  1997b:4). 

Lead  Times.  Total  acquisition  lead  time  (TALT),  also  referred  to  as  procurement 
lead  time,  is  comprised  of  administrative  lead  time  (ALT)  and  production  lead  time 
(PLT).  Their  definitions,  as  found  in  Appendix  G-2  of  DLA  Manual  4140.2,  are  as 
follows: 


Administrative  Lead  Time.  A  three  digit  numeric  field  used  in 
the  [Supply  Control  File]  SCF  to  express  the  time  interval  between 
the  date  of  the  supply  control  information  indicating  a  need  for 
purchase  and  the  award  of  an  order  or  contract  to  a  vendor.  This  time 
interval  includes  both  the  time  required  to  review  the  SCF  and  the 
time  required  to  award  the  order  or  contract.  This  time  interval,  when 
used  for  purchase  pmposes,  is  limited  to  the  time  interval  between 
citation  of  the  PR  and  the  award  date. 

Procurement  Lead  Time.  The  time  interval  between  the  award 
of  a  contract  and  the  availability  of  the  initial  significant  delivery  of 
materiel. 

To  elaborate,  procurement  lead  time  ends  with  receipt  of  the  first  largest  contract 
line  item  number  (CLIN).  CLINs  are  employed  to  identify  specific  shipments  in 
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contracts  with  split  quantities  shipped  to  multiple  locations.  The  terminology  "first 
largest"  refers  to  cases  where  there  are  two  or  more  CLINs,  for  equal  quantities,  that  are 
also  the  largest  quantity  in  the  contract  (Shields,  1 999b). 

Mission  Capable  CMICAPT  MICAP  is  an  Air  Force  term  used  to  reflect  the 
priority  of  an  item  in  terms  of  the  repair  of  mission  essential  equipment.  MICAPs  occur 
when  a  high  priority,  or  MICAP  reportable,  weapon  system  or  end  item  becomes  not 
mission  capable  (NMC)  or  partially  mission  capable  (PMC).  MICAP  also  refers  to  the 
procedures  and  system  used  to  obtain  the  assets  needed  to  maintain  mission  capability 
(AFMAN  23-1 10,  1999:  Ch  17). 

Department  of  Defense  Consumable  Inventory  Management 

DLA  is  at  the  top  of  a  multi-echelon  structure  in  terms  of  DoD  consumable  item 
management.  Demand  for  consumable  items  at  DLA  originate  at  the  retail  or  base  level 
as  a  result  of  the  failure  of  a  reparable  or  consumable  end  item,  or  a  consumable 
component  of  a  reparable  end  item.  As  shown  in  Figure  1,  demands  for  reparable  end 
items  are  forwarded  to  Air  Logistics  Centers,  who,  in  turn,  may  place  a  demand  on  DLA 
for  a  consumable  component  of  that  end  item.  Additionally,  demands  for  consumable 
parts  are  placed  on  DLA  from  individual  bases  and  other  services.  These  demands  are 
compiled  by  DLA,  and  become  DLA’s  total  demand. 

Economic  Order  Quantity  (BOOT  At  each  echelon,  a  variation  of  Wilson's 
Economic  Order  Quantity  (EOQ)  is  the  basic  inventory  model  used  to  determine  order 
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quantities.  Before  discussing  the  DLA  adaptations  relevant  to  this  study,  a  brief 
overview  of  EOQ  is  necessary. 


Figure  1.  Demand  Stream  for  Consumable  Items 
(Adapted  from  Gaudette,  1998:3) 


In  its  purest  form,  the  initial  order  quantity  (Q)  sets  the  inventory  level.  EOQ 
assumes  units  are  withdrawn  at  a  constant  demand  rate.  Knowing  this  demand  rate,  a 
reorder  point  is  established  based  on  the  “known”  lead-time  or  the  number  of  days 
required  to  receive  the  order  of  Q  units.  When  inventory  reaches  the  reorder  point,  an 
order  is  placed  for  Q  units,  and  as  the  remaining  units  are  withdrawn  the  order  for  Q  units 
is  produced  and  shipped.  EOQ  also  assumes  the  entire  quantity  of  new  units  is  received 
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at  one  time.  Theoretically,  the  order  is  received  just  as  the  inventory  level  reaches  zero 
(Tersine,  1994;  92).  Figure  2  depicts  this  process  in  the  classical  saw  tooth  diagram 
associated  with  EOQ. 

Although  EOQ  is  dependent  on  a  total  of  eight  assumptions,  it  is  generally 
considered  a  “robust”  model,  or  one  that  is  relatively  insensitive  to  changes  in  the 
model’s  parameters.  In  other  words,  even  if  the  assumptions  are  faulty,  the  model  will 
still  produce  output  reasonably  close  to  the  optimal  solution  (Tersine,  1 994: 1 02). 
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Figure  2.  Classical  EOQ  Model  (Adapted  from  Tersine,  1994:93) 


DLA  Variations  of  EOQ.  The  two  variations  to  the  fundamental  EOQ  model 
relevant  to  this  study  concern  the  safety  level  and  reorder  point  calculations.  Lead  time  is 
an  independent  variable  in  each,  so  variability  in  lead  time  can  result  in  inaccurate 
calculations. 


15 


Safety  Levels.  A  primary  purpose  of  inventory,  in  general,  is  to  serve  as  a 


buffer  against  variations  in  demand  or  lead  time.  Specifically,  safety  stock  is  a 
classification  of  inventory  used  to  account  for  short-term  variations  in  these  factors 
(Lambert  and  Stock,  1993:  399-404).  Figure  3  illustrates  the  role  of  safety  stock  in  the 
classical  EOQ  model.  In  this  hypothetical  case,  an  unexpected  increase  in  demand  or 
lead  time  results  in  the  EOQ  being  insufficient  to  meet  the  requirements  of  the  third 
cycle. 


Reorder 
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Figure  3.  Classical  Inventory  Model  with  Safety  Stock 
(Adapted  fi*om  Tersine,  1994:  539) 


DLA  uses  two  types  of  safety  stock,  fixed  safety  levels  (FSL)  and  variable  safety 
levels  (VSL).  Fixed  safety  levels  are  mainly  applied  to  non-stocked  items,  items  in  the 
DLA  system  less  than  two  years,  items  with  an  item  category  code  1  or  P,  and  items  with 
a  supply  status  code  of  6.  The  assignment  of  an  FSL  to  any  other  established  item,  or  one 
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in  the  DLA  system  over  two  years,  requires  the  approval  DLA  headquarters  (DLAM 
4140.2, 1965:  Ch  56). 

Variable  Safety  Levels  are  the  common  approach  for  most  items.  VSLs  attempt 
to  minimize  both  the  number  of  backorders  and  the  time  a  requisition  is  backordered. 

This  is  known  as  time-weighted  requisitions  short.  In  theory,  VSL  customizes  the  safety 
level  to  the  particular  traits  of  each  asset,  "thereby  making  maximum  use  of  available 
funds  by  neither  overinvesting  nor  imderinvesting  in  safety  stock"  (DLAM  4140.2). 

VSLs  allow  for  the  possibility  of  a  greater  number  of  backordered  requisitions  that  are  in 
backorder  status  for  a  shorter  period  of  time.  Some  of  the  factors  that  are  considered  in 
computing  VSLs  are  demand,  variance  of  demand,  lead  time,  unit  price,  number  of 
requisitions,  and  average  requisition  size. 

The  entire  process  for  calculating  both  types  of  safety  levels  is  complex  to  say  the 
least.  Appendix  D-187  of  DLA  Manual  4140.2,  Safety  Level  Computations,  contains  the 
21  page  flow-chart  describing  this  methodology.  As  this  study  pertains  to  DLA  lead  time 
variability,  this  section  highlights  the  primary  areas  where  lead  time  impacts  the  safety 
level  calculation. 

The  formula  for  computing  lead  time  demand  for  replenishment  of  item  i  is 
shown  below  as  given  in  section  la,  sub-section  9a  of  Appendix  D-187. 

LTD.  =  xPLT ,  where 
'  91 

QFD,  =  Quarterly  Forecasted  Demand  of  unit  i. 

PLT,  =  Procurement  Lead  Time 


17 


Dividing  the  QFD  by  91  creates  a  daily  demand  rate.  The  procurement  lead  time,  or 
TALT,  determines  the  number  of  expected  demands  during  TALT.  This  demonstrates 
the  basic  relationship  of  lead  time  to  requirements  determination.  That  is,  long  lead  times 
result  in  a  larger  lead  time  demand,  which,  in  turn,  results  in  a  higher  safety  level.  If  lead 


times  are  artificially  long,  the  result  is  unnecessary  investment  in  safety  levels.  Similarly 
artificially  short  lead  times  result  in  too  little  safety  stock,  the  consequence  of  which  may 
be  a  stockout  condition. 

The  next  step  is  the  computation  the  mean  absolute  deviation  of  demand  during 
TALT  (MADLT)  and  a  ratio,  Rl<.  The  equation,  as  given  in  Appendix  D-187,  is: 


Rl,= 


2.560xS jXQfXCjXB 


Z,x(MADLT,) 
Si  =  Average  requisition  size 


,  where 


Qi  =  EOQ 

C,  =  unit  cost 

B  =  backorder  rate 

Z/  =  Safety  Level  Essentiality  Factor 

Again,  lead  time  plays  a  critical  role.  In  this  case,  a  lead  time  that  experiences  a  high 
degree  of  variability  causes  a  lower  Rl,.  This  is  critical  because  the  ratio  RL  determines 
the  VSL  in  the  following  manner. 


IfRl,  <  0.0144,  then  VSL,  =3xl.25xMADLT, 


If  Rl,-  >—  0.0144,  then  VSL,  =  KjXMADLT, ,  where  K;  is  a  service  level 


factor  obtained  firom  Safety  Level  Table  III  (DLAM  4140.2, 1965:Appendix  D-187). 
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This  excerpt  demonstrates  the  importance  of  accuracy  and  variability  in  lead 
times  used  in  DoD  safety  level  computations.  This  translates  directly  to  inventory  levels 
through  the  computation  of  reorder  points. 

Reorder  Point.  One  of  the  assumptions  EOQ  is  foimded  upon  is  a  constant 
and  known  lead-time  that  is  used  to  compute  a  reorder  point.  In  the  classical  model,  the 
reorder  point  (B)  is  computed  by  multiplying  the  annual  demand  (R)  for  the  item  by  the 
lead  time  (L),  and  the  product  is  divided  by  the  length  of  time  corresponding  to  the  lead 
time  expression.  For  example,  for  lead  times  expressed  in  days  the  equation  reads, 
B=(R*L)/365.  When  on  hand  assets  plus  on-order  assets  minus  backordered  assets 
equals  the  reorder  point  quantity,  another  is  placed  for  Q  units  (Tersine,  1994:94-95).  If 
the  expected  lead  time  is  artificially  long,  the  reorder  point  is  set  higher  than  necessary  to 
account  for  the  demands  during  the  actual  lead  time,  which,  in  turn,  results  in 
unnecessary  inventory  investment.  On  the  other  hand,  if  the  expected  lead  time  is  shorter 
than  the  actual  lead  time,  a  materiel  shortage  may  result  at  some  point  prior  to  receipt  of 
the  order  quantity. 

DLA  determines  the  reorder  point  for  replenishment  demand  items  by  summing 
five  factors.  The  five  factors  are  the  System  Safety  Level  Quantity  (SSLQ),  special 
levels  to  support  the  Atlantic  and  Pacific  fleets,  Other  War  Reserve  Materiel  quantities, 
special  levels  established  for  items  assigned  a  Supply  Status  Code  6  with  Standardization 
Status  Code  3  or  E,  and  "all  requirements  through  a  time  period  equal  to  the  PLT 
[procurement  lead  time]  (ALT  plus  PLT)"  (DLAM  4140.2, 1965:  Ch  32).  The  effect  of 
erroneous  lead  time  data  on  SSLQ  was  demonstrated  in  the  previous  section.  For  the 
purposes  of  this  study,  the  only  other  factor  that  is  reliant  on  accurate  lead  time  data  is  the 


19 


determination  of  demand  during  lead  time.  In  inventory  parlance,  this  is  the  pipeline 
quantity.  As  in  the  classical  EOQ  model,  lead  times  that  are  actually  longer  than 
anticipated  result  in  insufficient  quantities  to  meet  demand  during  lead  time,  and  shorter 
actual  lead  times  result  in  more  assets  than  are  needed  to  meet  said  demand. 

Therefore,  lead  time  affects  two  of  the  five  determinants  of  reorders  point,  safety 
level  and  pipeline  quantity.  Inaccurate  data  may  result  in  reorder  points  either  above  or 
below  the  optimal  level.  Artificially  high  reorder  points  result  in  the  inefficient  use  of 
inventory  funds  through  the  premature  purchase  of  assets,  while  artificially  low  reorder 
points  result  in  lower  inventory  levels,  that  may  effect  weapon  system  readiness. 

DLA  Lead  Time  Methodology.  The  procedure  for  calculating  both  ALT  and  PLT 
is  remarkably  simple.  Both  are  automatically  computed  on  a  weekly  basis  using  only 
representative  procurement  processes.  DVD  lead  times  are  not  considered  as 
representative  procurements.  The  automatic  update  to  ALT  and  PLT  is  only  averted 
when  the  rate  of  change  between  the  new  lead  time  and  previous  lead  time  exceeds  a 
parameter  normally  set  at  ±  50  percent.  If  the  new  computed  lead  time  exceeds  this 
tolerance,  a  management  notice  is  generated  for  review  (DLAM  4140.2, 1965:  Ch  32). 

Administrative  Lead  Time.  ALT  computations  are  generated  by  the 
Contracting  Subsystem  by  an  Award  Leadtime  Transaction.  The  interval  is  the  time 
between  the  recommended  buy  date  and  award  date.  A  30-day  minimum  is  assigned  to 
all  stock  replenishment  items  unless  an  item  is  procured  under  a  "requirements  type 
contract".  In  this  case,  ALT  equals  the  interval  between  the  recommended  buy  date  and 
"the  date  a  call  is  placed  against  a  contract"  (DLAM  4140.2, 1965:  Ch  32). 
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New  ALTs  are  computed  using  a  weighted  average  of  the  past  two  contracting 
actions.  The  most  common  calculation  is  the  sum  of  67  percent  of  the  "latest  actual" 
ALT  and  33  percent  of  the  previous  ALT.  Any  deviation  from  these  weights  requires 
DLA-OSR  approval  (DLAM  4140.2, 1965;  Ch  32). 

Production  Lead  Time.  PLT  computations  begin  with  the  Award 
Leadtime  Transaction,  and  the  estimated  contract  delivery  date  is  used  for  the  end  date. 
This  is  automatically  updated  when  a  receipt  transaction  is  processed  for  51  percent  of 
the  CLIN  or  for  a  specific  quantity  assigned  to  that  item.  The  new  PLT  is  computed  as 
described  above  for  ALT. 

In  terms  of  the  management  questions  presented  in  Chapter  I,  expected  lead  times 
shorter  than  actual  lead  times  may  lead  to  stockout  conditions,  which  could  be  a 
contributing  factor  in  the  determination  of  an  item  as  a  problem  part.  Conversely,  longer 
expected  lead  times  result  in  reorder  points  set  higher  than  necessary,  which  may 
contribute  to  the  accxunulation  of  excess  materiel. 


Performance  of  EOO  in  the  Department  of  Defense 

There  are  two  primary  reasons  to  scrutinize  the  performance  of  EOQ  in  the  DoD. 
First,  in  the  past  decade  the  Government  Accounting  Office  (GAO)  has  issued  a  plethora 
of  reports  criticizing  defense  inventory  management.  The  second  compelling  reason  to 
investigate  consumable  item  lead  time  variability  is  the  potential  to  increase  weapon 
system  readiness. 
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GAO  Criticisms  of  Defense  Inventory  Management.  Inthelate  1980’s,bythe 
direction  of  the  House  of  Representatives  Committee  on  Government  Reform  and 
Oversight  and  the  Senate  Committee  on  Governmental  Affairs,  the  GAO  began 
examimng  DoD  stockage  policies.  Due  to  the  subject’s  budgetary  implications,  it  was 
soon  raised  to  the  GAO’s  “High  Risk  Series”  (Gaudette,  1998:19).  In  a  1992  report,  the 
GAO  stated  that  one-half  of  the  $77.5  billion  DoD  inventory  was  excess.  Furthermore, 
the  GAO  recommended  that  the  DoD  change  its  standard  practices,  increase  the  use  of 
commercial  practices,  revise  its  performance  measures,  and  integrate  improved  computer 
technology  to  better  control  inventory  (GAO,  1995:9). 

Defense  inventory  management  has  remained  on  GAO’s  High-Risk  Series 
throughout  the  decade,  with  GAO  reports  continuing  to  give  emphasis  to  the  use  of 
commercial  practices.  In  1990  the  GAO  identified  an  increase  in  DoD  lead  time 
requirements  during  the  previous  decade  of  $1 3  billion.  It  directed  the  services  and  DLA 
to  initiate  measures  designed  to  reduce  lead  times  by  25  percent.  This  goal  was  based  on 
a  1986  DoD  memorandum,  which  cited  a  DoD  initiated  study  by  the  Logistics 
Management  Institute,  that  claimed  a  25  percent  decrease  was  feasible  by  employing 
commercial  practices.  Moreover,  the  memorandum  underscored  the  importance  of  lead 
time  by  stating  that  a  one  day  reduction  equated  to  a  $10  million  reduction  in  future 
purchases.  As  a  result  of  this  report,  DoD  directed  the  services  and  DLA  to  undertake 
lead  time  reduction  initiatives  which  included  the  establishment  of  total  acquisition  lead 
time  (TALT)  goals,  the  reduction  of  production  lead  time  in  contract  negotiations,  and 
the  expansion  of  multiyear  contracts  and  indefinite  quantity  contracts  (GAO,  1994:2-3). 
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In  a  1995  follow-up  report,  GAO  found  limited  progress  across  DoD  in  TALT. 
Table  1  shows  the  change  in  average  lead  time,  in  days,  for  each  service  and  DLA  from 
1990  to  1994.  Among  the  specific  findings  relating  to  the  sources  of  supply,  the  report 
foimd  that  DLA  did  not  implement  the  first  two  of  DoD's  1990  lead  time  reduction 
initiatives.  As  of  October  1994,  although  DLA  proposed  a  30  percent  reduction  in  lead 
time,  this  policy  had  yet  to  be  implemented.  GAO  further  recommended  a  periodic 
validation  of  recorded  lead  times  based  on  a  review  of  two  Air  Force  Air  Logistics 
Centers  and  the  U.S.  Army  Aviation  and  Troop  Command.  As  a  result  of  the  latter's 
recent  production  lead  time  (PLT)  review,  changes  were  made  to  75  percent  of  the  assets 
reviewed,  and  94  percent  of  those  changes  were  decreases.  "The  command  estimated  net 
annual  procurement  savings  of  $88  million  from  using  updated  lead  times  to  compute 
buy  requirements"  (GAO,  1994:4). 

A  1996  GAO  report  focusing  on  requirements  determination  cited  inaccuracies  in 
the  data  in  Air  Force  and  Navy  automated  requirements  computation  systems  that 
contributed  to  a  combined  $132  million  more  than  required  for  aircraft  engine  spares. 

The  sample  included  the  Air  Force's  F-lOO-lOO  engine  and  the  Navy's  F-404  engine. 
Among  other  data  elements  specifically  cited  as  "unsupported  or  incorrect"  were  lead 
times  (GAO,  1996:2). 


Table  1.  Changes  in  Average  Lead  Time  Days  between  1990  and  1994 

(GAO,  1994:2) 


COMPONENT 

1990 

1994 

DAYS 

PERCENT  CHANGE 

NAVY 

715 

522 

193 

27.0 

ARMY 

711 

690 

21 

3.0 

AIRFORCE 

614 

620 

(6) 

DLA 

309 

293 

16 

5.0 

DoD  AVERAGE 

587 

531 

56 

9.0 
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GAO's  vigilant  monitoring  of  defense  inventory  continued  in  earnest  in  1997.  In 
a  follow-up  to  the  1995  High-Risk  Series  report,  GAO  listed  12  findings  citing  DoD's 
limited  or  non-existent  progress  in  changing  the  management  culture.  The  report  credited 
DoD  for  the  reduction  in  secondary  inventory  to  $69.6  billion.  The  GAO  defines 
secondary  inventory  as  spare  and  repair  parts,  clothing,  medical  supplies,  and  other 
support  items  (GAO,  1997d:l).  For  all  intensive  purposes,  this  includes  all  inventories 
except  equipment  items.  Of  the  $69.6  billion  total  inventory,  $19.2  billion  was 
consumable  items  (GAO,  1997a:4).  The  report  still  claimed,  however,  that  half  of  the 
total  was  not  needed  for  war  reserve  materiel  or  to  support  current  operations  (GAO, 
1997d:l).  The  GAO  refers  to  this  as  "unneeded"  inventory.  A  July  1997  report  focused 
on  consumable  items  in  particrdar.  The  report  criticized  DL A  management  of 
consumable  inventory  totaling  approximately  four  million  items  valued  at  $1 1.1  billion 
(GAO,  1997b:  4).  GAO  recommendations  concentrated  on  the  use  commercial  best 
practices,  including  moving  away  from  direct  vendor  delivery  (DVD)  contracts  and 
towards  increased  use  of  prime  vendors  or  integrated  suppliers.  GAO  also  found  that 
delivery  of  items  imder  DVD  contracts  averaged  twice  as  long  as  delivery  of  items 
stocked  in  DLA  supply  points  (GAO,  1997b:7). 

Continuing  with  the  review  of  GAO  reports,  another  1997  report  claimed  that 
unneeded  inventory  totaled  $41 .2  billion.  According  to  this  report,  of  the  $26.6  billion  of 
unneeded  with  demand  data,  $1.1  billion  would  account  for  at  least  100  years  of  supply 
(GAO,  1997c:3).  Table  2  provides  a  summary  of  the  unneeded  inventory  as  found  in  this 
report.  In  1998,  GAO  mined  further  into  the  consumable  inventory  and  reported  on 
DoD's  hardware  inventory.  This  category  included  items  such  as  bearings,  valves,  and 


24 


bolts,  which  totaled  $5.7  billion.  This  report  was  particularly  critical  of  DLA  as  the 
manager  of  the  majority  of  consumable  items,  of  which  97  percent  were  classified  as 
hardware  items  (GAO,  1998:2).  The  report  again  criticized  DLA  for  excess  inventory 
levels  stemming  from  inefficient  management  and  failure  to  institute  commercial  best 
practices  on  a  wide-scale  basis. 

The  criticisms  of  DoD  inventory  management,  and  of  DLA  in  particular  can  be 
summarized  into  two  primary  areas.  First,  the  organizational  culture  within  the  inventory 
management  arena  of  DoD  remains  resistant  to  a  reengineered  logistics  system. 

Although  some  progress  is  evident,  GAO  continues  to  emphasize  the  use  of  best  practices 
as  a  means  of  affecting  the  necessary  change.  Second,  excess  inventory  remains  a  critical 
problem.  In  an  era  of  stagnant  or  declining  defense  budgets  and  increasing  concern  over 
readiness  of  weapon  systems,  excess  inventory  is  a  critical  target  as  money  saved  by  not 
buying  urmeeded  items  can  be  redirected  to  more  critical  repair  assets. 


Table  2.  Lfnneeded  Secondary  Inventory  by  DoD  Component 
(GAO,  1997c:4) 


INVENTORY  ANALYZED 
(value  in  billions) 

UNNEEDED  INVENTORY 
(value  in  billions) 

COMPONENT 

ITEMS 

VALUE 

ITEMS 

VALUE 

ARMY 

117.610 

$9.0 

63.362 

$4.8 

NAVY 

334.337 

17.6 

172.325 

11.2 

AIRFORCE 

289.438 

31.1 

140.220 

19.1 

DLA 

2.515.231 

9.3 

1.548.545 

6.1 

TOTAL  1 

3.256.616 

$67.0 

1.924.452 

$41.2 
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Consumable  Items  and  Air  Force  Readiness 

DLA  manages  over  4  million  items,  and  has  annual  sales  to  the  armed  services 
nearing  $13  billion  (Glisson).  Obviously,  not  all  of  these  items  are  directly  related  to  a 
vi^eapon  system.  In  order  to  identify  those  that  are  related,  DLA  instituted  a  Weapon 
System  Support  Program  (WSSP)  in  1981,  which  allows  the  services  to  identify  those 
items  that  are  components  to  critical  end-items.  As  EOQ  is  the  model  DLA  uses  to 
manage  its  inventory,  this  large  volume  of  business  suggests  the  importance  of  EOQ  to 
the  readiness  of  those  critical  end-items. 

MICAP  Incidents.  One  general  method  of  gauging  the  importance  of 
consumables  to  readiness  is  via  Air  Force  MICAP  incidents.  As  stated  earlier,  a  MICAP 
incident  occurs  because  a  weapon  system,  or  other  end  item  coded  with  a  MICAP 
reportable  designator,  is  either  NMC  or  PMC  due  to  lack  of  an  asset  on  hand  to  plug  the 
"hole"  caused  by  the  failure  of  a  component.  The  following  data  summarize  three  reports 
generated  by  the  Air  Force  Materiel  Command  Readiness  Assessment  Module  (RAM). 
The  complete  reports  are  provided  in  Appendix  B.  RAM  pulls  data  directly  from  the 
WSMIS  database.  In  fiscal  year  (FY)  1998,  there  were  457,319  new  MICAP  incidents 
Air  Force  wide,  which  totaled  140,559,191  hours.  Of  these,  132,856  incidents,  totaling 
43,613,214  MICAP  hours,  could  be  traced  to  DLA  as  the  source  of  supply  (Air  Force 
Materiel  Command).  Thus,  DLA  assets  accounted  for  29.1  percent  of  Air  Force  MICAP 
incidents  and  3 1 .0  percent  of  MICAP  hours  in  FY98.  Furthermore,  199,294,  or  43.6 
percent,  of  all  Air  Force  MICAPs  were  consumable  items.  Put  another  way,  two-thirds 
of  all  consumable  MICAPs  in  FY98  were  DLA  managed.  In  terms  of  MICAP  hours. 
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consumable  items  accounted  for  40  percent  of  the  total  Air  Force  MICAP  hours,  and 
DLA  managed  items  accounted  for  77,6  percent  of  the  total  consumable  hours.  This  data 
is  provided  to  demonstrate  that  DLA  consumable  items  remain  a  significant  portion  of 
both  MICAP  incidents  and  MICAP  hours.  However,  further  quantification  of  the 
potential  impact  of  consumable  items  on  readiness  has  rarely  been  attempted. 

Aircraft  Availability.  A  1990  report  by  Christopher  Hanks  of  the  Logistics 
Management  Institute  (LMI)  directly  tied  consumable  items  to  weapon  system  readiness 
by  adapting  a  fundamental  concept  of  the  aircraft  availability  model  to  consumables. 
Hanks  focused  on  base-level  unit  expected  backorders  (EBOs)  because  the  lack  of  a 
desired  part  at  the  base  level  is  directly  related  to  the  NMC  status  of  a  weapon  system  (1- 
5).  The  backorders  are  later  tied  to  aircraft  availability,  but  first,  an  interim  step  relating 
high  priority  due  outs  to  mission  capable  rates  is  needed. 

Hanks  was  able  to  focus  on  weapon  systems  through  limiting  his  study  to  parts  in 
the  WSSP  and  those  with  priority  1  and  2  "due-outs"  under  the  DoD  Uniform  Materiel 
Movement  and  Issue  Priority  System  guidelines.  Priority  1  is  reserved  for  units  in 
combat,  while  priority  2  is  used  for  other  essential  requisitions  such  as  MICAPs,  items 
awaiting  parts  in  repair  shops,  and  readiness  spares  packages.  A  "due-out,"  in  Air  Force 
terminology,  simply  represents  an  asset  that  was  not  available  at  the  time  it  was 
requested.  In  1989,  there  were  approximately  200,000  high  priority  due  outs  for  DLA 
and  Air  Force  Logistics  Command  assets.  By  multiplying  the  sum  of  the  aggregated 
NMC  and  PMC  rates  for  FY  89  times  the  fleet  size  of  9100,  he  was  able  to  generalize 
that  the  200,000  priority  1  and  2  requisitions  corresponded  to  1300  aircraft  either  NMC 
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or  PMC.  Hanks  acknowledged  that  all  priority  2  requisitions  are  not  necessarily  causing 
a  MICAP  condition,  nor  are  they  all  related  to  aircraft  (1-12). 

The  connection,  according  to  Hanks,  is  that  this  procedure  can  be  used  to  predict, 
"within  a  reasonable  range,"  the  change  in  aircraft  in  NMC  and  PMC  status  based  on 
changes  in  the  number  of  high  priority  requisitions.  For  example,  since  DLA  items 
accounted  for  25-33  percent  of  all  high  priority  due-outs,  a  10  percent  increase  in  DLA 
high  priority  due-outs  for  DLA  managed  items  would  result  in  approximately  32-43  (2.5- 
3.3  percent  of  1300)  additional  aircraft  in  NMC  or  PMC  status  (1-13). 

Finally,  Hanks  developed  a  model  to  equate  changes  in  wholesale  safety  levels  to 
aircraft  availability.  A  wholesale  inventory  model  approximating  the  SAMMS 
methodology  for  over  170,000  assets  was  designed  to  predict  the  percentage  change  in 
EBOs  at  the  wholesale  level  based  on  changes  in  safety  levels.  The  model  showed  that 
an  aggregate  20  percent  reduction  in  safety  levels  equated  to  a  25  percent  increase  in 
wholesale  EBOs  (2-16).  He  used  the  model  to  develop  a  baseline  that  "every  $10  million 
reduction  in  wholesale  safety  levels  at  DLA  for  demand-based  WSSP/USAF  items  has 
the  potential  to  groimd  or  render  PMC  6  to  8  aircraft. . . "  (2-3). 

It  must  be  acknowledged  that  DLA's  influence  on  readiness  is  to  a  large  degree 
constrained  by  retail  level  inventory  decisions.  Although  the  RAM  output  referenced 
above  does  not  provide  MICAP  cause  codes,  only  one  of  the  five  most  common  reasons 
for  a  MICAP  incident  can  be  tied  to  wholesale  supply  (Hanks,  1993:3-4). 
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Summary 


Chapter  II  provided  a  foundation  for  this  research  through  a  review  of  the  Wilson 
EOQ  model  used  as  the  basis  for  DoD  consumable  inventory  management,  and  on  the 
DLA  variations  to  the  model.  Particular  attention  was  paid  to  the  components  of  DLA 
requirements  determination  where  lead  time  impacts  inventory  levels.  Finally,  a 
justification  for  analysis  of  lead  time  variability  was  presented  through  numerous  General 
Accounting  Office  (GAO)  reports  on  DoD  inventory  management  and  by  demonstrating 
the  impact  of  consumable  items  on  the  readiness  of  Air  Force  weapon  systems. 
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III.  Methodology 


Introduction 

The  purpose  of  this  chapter  is  to  explain  the  procedures  used  to  answer 
investigative  questions  three  through  eight  posed  in  Chapter  I,  including  the  data 
collection  process  and  a  roadmap  for  the  statistical  analysis.  The  ultimate  goal  of  these 
investigative  questions  is  to  identify  if  significant  differences  exist  in  administration  lead 
time  (ALT)  and  production  lead  time  (PLT)  for  problem  parts  versus  non-problem  parts 
for  the  FI  10-100  and  FlOO-129  engines,  and  determine  the  degree  of  variability 
experienced  in  deviations  from  the  system  lead  times.  To  accomplish  these  goals, 
various  categories  of  consumable  items  are  analyzed  in  an  effort  to  uncover  a  possible 
source  of  any  significant  deviation  from  the  system  lead  times  utilized  by  the  Defense 
Logistics  Agency  (DLA).  The  existence  of  a  significant  difference  may  lend  weight  to 
the  need  to  devote  further  study  to  the  issue  of  lead  times  in  DLA  requirements 
computations. 


General  Approach 

In  general,  this  study  is  directed  at  examining  the  acquisition  lead  times  used  by 
DLA  in  consumable  item  management  to  determine  if  sufficient  variability  or  uncertainty 
exists  to  warrant  a  reevaluation  of  this  methodology  at  the  wholesale  level  of  supply  in 
the  Air  Force.  To  that  end,  the  remainder  of  this  study  concentrates  on  the  two 
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components  of  total  acquisition  lead  time  (TALT),  administrative  lead  time  (ALT)  and 
production  lead  time  (PLT). 

As  individual  items  are  generally  assigned  unique  ALTs  and  PLTs,  the  data  must 
be  standardized  before  it  is  analyzed.  This  is  accomplished  by  subtracting  the  forecasted 
lead  time  as  foimd  in  the  Standard  Automated  Materiel  Management  System  (SAMMS) 
from  the  observed  lead  time,  and  these  deviations  then  become  the  sample  of  interest. 
The  next  step  is  to  conduct  statistical  analyses  with  the  purpose  of  drawing  inferences 
that  will  aid  in  answering  management  and  research  questions  stated  in  Chapter  1 . 


Data  Collection 

In  order  to  answer  the  investigative  questions,  lead  time  data  was  collected  for  14 
Air  Combat  Command  (ACC)  problem  items  and  23  bench  stock  items  with  a  serviceable 
balance.  The  data  was  validated  and  examined  for  outliers  using  histograms  and  box  and 
whiskers  plots.  The  remainder  of  this  chapter  explains  the  data  collection  and  validation 
process  as  well  as  the  statistical  tests  performed. 

First,  a  list  of  problem  parts  was  sought  from  the  ACC  Regional  Supply  Squadron 
(RSS).  The  ACCRSS  was  formed  to  provide  centralized  supply  support  to  all  ACC 
bases,  and  global  supply,  fuels  accoimting,  and  computer  support  to  warfighting 
Commander-in-Chiefs  (ACCRSS,  1999).  One  of  the  many  supply  functions  that  were 
centralized  was  the  management  of  MICAP  items.  As  a  result,  the  ACCRSS  now 
manages  all  MICAPs  for  all  ACC  bases.  Moreover,  the  regionalized  MICAP  section  has 
visibility  over  all  ACC  MICAPs  and  maintains  daily  contact  with  item  managers,  hence. 
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it  is  the  ideal  source  for  obtaining  this  portion  of  the  data.  The  samples  used  to  assess  the 
lead  time  assumptions  come  from  the  population  of  XB3  coded  parts  for  the  FI  10-100 
and  FI  10-129  engines.  ACC  was  chosen  as  the  initial  source  for  acquiring  the  two 
sample  sets  of  data,  as  a  substantial  proportion  of  the  F- 16  aircraft  that  use  these  engines 
are  ACC  assets. 

Second,  a  set  of  non-problem  items  was  selected  as  a  control  group.  The  source 
selected  for  this  data  was  the  Shaw  Air  Force  Base  Bench  Stock  account.  By  definition,  a 
Bench  Stock  is  a  group  of  consumable  assets,  used  with  such  frequency  by  maintenance 
activities  that  they  are  issued  to  users  before  they  are  needed  and  forward  located  at  the 
user's  facility  (AFMAN  23-1 10,  1999:25-1).  Additionally,  the  20th  Fighter  Wing  at 
Shaw  is  the  largest  F-16  combat  wing  in  the  Air  Force.  These  two  factors  made  its  Bench 
Stock  a  feasible  starting  point  for  non-problem  item  data  collection. 

Problem  Parts.  The  first  sample  of  interest  is  naturally  the  focus  of  the  study,  and 
is  that  subset  of  the  population  that  is  considered  problem  parts.  For  this  study,  problem 
parts  are  items  determined  to  be  the  fleet  problem/pacing  items  by  the  weapon  system 
spares  manager,  based  on  MICAP  hours/incidents,  known  or  anticipated  spares  shortfalls, 
and  modifications  (Regional  Supply  Squadron,  1999a).  As  of  22  April  1999, 15  of  the 
top  30  FI 00-1 10  engine  MICAP  drivers  for  ACC  were  consumable  items  managed  by 
DLA  (Regional  Supply  Squadron,  1999b). 

Bench  Stock.  The  items  in  this  sample  were  selected  from  the  Shaw  Air  Force 
Base  jet  engine  shop's  bench  stock.  A  total  of  30  bench  stock  National  Stock  Numbers 
(NSNs)  were  provided  by  the  20th  Supply  Squadron  Customer  Service  element.  Of 
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these,  three  were  eliminated  as  they  were  also  on  the  problem  parts  list  provided  by  the 
ACCRSS. 


Analysis  of  Data 

The  42  NSNs  were  forwarded  to  Air  Force  Material  Command's  Requirements 
Interface  Process  Improvement  Team  to  validate  the  source  of  supply.  A  search  of  an 
AFMC  database  revealed  that  all  42  NSNs  were  DLA  managed  items.  The  NSNs  were 
then  forwarded  to  Business  Analysis  Unit's  Corporate  Performance  Team  at  the  Defense 
Supply  Center  Columbus  (DSCC).  The  data  returned  was  the  end  of  quarter  lead  time 
forecast  for  the  last  eight  quarters,  and  the  end  of  year  forecast  through  1989  for  14  of  the 
15  problem  parts,  and  24  of  the  27  bench  stock  items.  A  total  of  903  CLINs,  or 
observations,  were  contained  in  the  raw  data.  DSCC  also  identified  DSC  Richmond  and 
DSC  Philadelphia  as  the  managers  of  the  42  items.  Appendix  C  lists  each  NSN  for  which 
data  was  available  along  with  the  associated  nomenclature  from  the  Standard  Base 
Supply  System. 

The  data  provided  by  DSCC  were  the  historical  records  in  the  DLA  Integrated 
Data  Base  system  dating  back  to  1989.  As  such,  it  also  indicated  whether  the  contract 
was  direct  vendor  delivery  (DVD)  or  stock  replenishment,  which  enabled  this  study  to 
further  categorize  the  data  and  complete  additional  hypothesis  tests. 
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Data  Validation 


Several  problems  were  encountered  with  the  raw  data.  Some  of  these  were  the 
result  of  the  nature  of  the  procurement  process  and  varying  information  systems  used 
among  the  different  branches  of  service,  retail  supply  organizations,  and  DLA. 

Receipt  Dates.  Since  receipt  dates  determine  the  end  of  PLT,  it  is  important  to 
understand  the  methodology  used  to  track  inventory  transactions  in  the  DLA  Integrated 
Data  Base.  This  methodology  affects  the  PLT  of  both  types  of  purchase  discussed  below. 

Stock  Replenishment.  Split  quantity  stock  replenishment  orders  occur 
when  contracts  are  let  for  multiple  quantities  or  partial  shipments  are  received.  The 
receipt  date  in  the  database  in  this  instance  is  the  most  recent,  or  longest,  delivery  date. 
For  example,  a  vendor  can  ship  90  items  one  week  and  the  remaining  10  the  following 
week.  The  DLA  contract  file  will  overlay  the  date  received  with  the  most  current  date. 
Hence,  the  file  contains  the  longer  lead  time  (Shields,  1 999a) 

Direct  Vendor  Deliveries  (DVD).  A  similar  issue  exists  in  terms  of  parts 
contracted  for  DVD.  The  receipt  date  for  items  procured  for  direct  vendor  delivery  to  the 
end  user  is  dependent  upon  the  end  user's  input  into  their  applicable  management  system. 
This  date  can  be  suspect  because  in  many  cases  there  are  multiple  deliveries  set  for  a 
single  contracting  action.  Thus,  the  possibility  exists  for  a  lag  in  the  input  and/or  a  lag  in 
any  services  management  system  updating  the  DLA  files.  DVD  encompasses  those  parts 
shipped  directly  fi:om  the  manufacturer  or  retailer  to  file  end  user.  DLA  must  rely  on  the 
receipt  date  input  by  the  receiving  organization  as  its  receipt  date.  Given  the  quantity  and 
variety  of  customers  receiving  DVD  items,  it  is  this  author's  opinion  that  individual 
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verification  by  DLA  of  these  dates  is  infeasible  and  offers  little  value.  For  the  purposes 
of  this  research  effort,  the  dates  were  accepted  as  accurate  reflections  of  receipt  dates. 

Incomplete  Records.  Another  problem  encountered  was  that  the  records  of  a 
significant  portion  of  the  NSNs  were  missing  programmed  lead  times.  As  these 
represented  a  significant  portion  of  the  total  observations,  they  were  identified  to  DSCC 
and  further  research  was  necessary  to  obtain  the  data.  It  was  determined  that  the  cause 
was  the  transfer  of  items  from  closing  facilities  due  to  Base  Realignment  and  Closing, 
and  DSCC  was  able  to  provide  the  missing  data. 

Multiple  Contracting  Lines.  Some  of  the  observations  in  the  database  were  the 
result  of  multiple  CLINs.  This  is  the  result  of  partial  quantities  being  ordered  for  the 
same  recommended  buy  under  a  single  contract.  Thus,  when  the  contract  is  awarded, 
multiple  observations  occur  with  the  same  ALT.  Similarly,  the  partial  quantities  were 
frequently  received  on  the  same  date,  resulting  in  multiple  PLT  observations.  These 
duplicate  observations  weighted  the  data,  and  to  avoid  biasing  the  results,  only  one 
observation  per  CLIN  was  included  in  the  analysis. 

Open  Contracting  Actions.  The  final  problem  was  that  in  a  nvimber  of  cases 
contracting  actions  were  not  complete,  and  no  receipt  date  was  available.  Thus,  an  actual 
PLT  could  not  be  calculated.  This  resulted  in  different  sample  sizes  for  the  statistical 
analysis. 

After  validating  the  raw  data,  a  total  of 473  observations  remained  to  be  analyzed. 
Of  these,  1 85  were  for  problem  parts,  and  288  were  for  non-problem  parts.  In  the  type  of 
purchase  category,  202  were  DVD  contracts,  and  271  were  for  stock  replenishment. 
However,  for  the  reasons  explained  above,  not  all  observations  had  usable  values  for  both 
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ALT  and  PLT.  Appendix  D  contains  all  473  observations  with  which  the  analysis  was 


conducted. 


Variables  Used  in  Analysis 

The  variables  below  were  used  for  both  categorization  and  data  analysis. 

Deriving  system  lead  times  from  the  end  of  quarter  and  end  of  year  values  required  some 
mampulation.  As  these  values  were  the  actual  forecast  for  the  subsequent  period,  they 
were  considered  as  the  system  lead  time  for  the  first  contracting  action  in  the  subsequent 
period.  For  all  other  observations  in  a  period,  the  system  lead  time  utilized  for  analysis 
was  an  average  of  the  forecast  for  the  period  in  which  the  observation  occurred  and  the 
forecast  for  the  next  period.  Actual  lead  times  were  computed  by  taking  the  difference 
between  the  Julian  dates  provided  in  the  data  file.  The  recommended  buy  date  and 
contract  award  dates  were  used  for  ALT,  and  contract  award  date  and  receipt  dates  were 
used  for  PLT. 

System  ALT.  The  system  ALT  refers  to  the  administrative  lead  time  as  contained 
in  the  SAMMS  database. 

ALT  (actuaiy  ALT  (actual)  is  the  actual  number  of  days  between  the 
recommended  buy  date  and  contract  award  for  any  particular  contracting  action. 

System  PLT.  The  system  PLT  is  the  production  lead  time  as  contained  in  the 
SAMMS  database. 
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PLT  (actual.  PLT  (actual)  is  the  actual  number  of  days  between  contract  award 
and  receipt  of  a  significant  quantity  (51  percent)  of  the  first  largest  order  for  stock  buys, 
or,  for  direct  vendor  delivery,  the  date  input  into  the  system  by  the  receiving  unit. 

Reason  for  purchase.  This  variable  represents  whether  a  particular  purchase  was 
undertaken  for  DLA  stock  replenishment  or  DVD. 

In  the  cases  where  different  actual  ALTs  and  PLTs  were  observed  for  multiple 
CLIN  DVD  contracts,  each  distinct  value  was  accepted  as  a  separate  observation.  For 
different  lead  times  in  multiple  CLIN  stock  replenishment  contracts,  the  lead  time 
corresponding  to  51  percent  of  the  first  largest  CLIN  was  used  in  this  analysis. 


Preliminary  Evaluation  of  Data 

Before  delving  into  a  discussion  of  the  data,  a  brief  review  of  the  organization  of 
the  sample  data  is  warranted.  This  is  followed  by  a  description  of  the  statistic  to  be  tested 
under  the  two-sample  t-test  heuristic. 

OrpaniTation  of  Data.  Each  of  the  six  cases  compares  the  ALT  and  PLT  of  two 
categories  of  items.  Cases  1  and  2  examine  the  difference  in  ALT  and  PLT  between 
problem  parts  and  non-problem  and  DVD  and  stock  replenishment,  respectively.  Cases  3 
and  4  examine  the  problem  part  and  non-problem  part  columns,  respectively,  on  the  basis 
of  type  of  purchase.  Finally,  Cases  5  and  6  compare  lead  times  of  problem  parts 
purchased  for  stock  replenishment  versus  non-problem  parts  purchased  for  stock 
replenishment,  and  problem  parts  purchased  for  DVD  and  non-problem  parts  purchased 
for  DVD,  respectively. 
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Derivation  of  Test  Statistic.  Although  the  data  for  each  NSN  in  this  study  is  a 
chronological  history  of  contracting  actions,  it  is  not  suspect  to  auto-correlation.  This  is 
due  to  the  aggregate  analysis  statistical  method  described  below.  In  each  of  the  six  cases, 
the  system  ALT  and  PLT  for  every  item  in  both  categories  are  subtracted  from  the 
observed  values  (x,)  for  every  contracting  action.  This  difference  (D/)  is  totaled  across 

each  category  and  the  mean  (  Z>  f)  is  compared  to  the  mean  of  the  differences  for  the 
corresponding  category. 

Nature  of  Data.  In  order  to  make  an  initial  assessment  of  the  data  to  be  analyzed, 

a  histogram  and  box  and  whiskers  chart  of  the  calculated  differences  for  each  category 

are  created.  Any  points  identified  as  outliers  are  individually  examined  to  ascertain  the 

nature  of  the  unusual  measurement.  Outliers  that  are  determined  to  be  members  of  a 

different  population  or  incorrectly  recorded  or  computed  are  removed  from  the  sample, 

and  new  histograms  and  box  and  whiskers  charts  are  run  for  that  sample.  Finally,  a 

critical  underlying  assumption  of  the  parametric  tests  used  in  this  study  is  that  the  sample 

distribution  of  the  test  statistic  is  approximately  normal.  Due  to  the  large  sample  size,  the 

Central  Limit  Theorem  can  be  invoked  and  this  sampling  distribution  can  be  assumed  to 

be  approximately  normal.  As  stated  in  Statistics  for  Business  and  Economics. 

Consider  a  random  sample  of  n  observations  selected  from  a 
population  {any  population)  with  mean  p  and  standard  devi¬ 
ation  G.  Then,  when  n  is  sufficiently  large,  the  sampling 
distribution  of  x  will  be  approximately  a  normal  distribution 
with  mean  p  and  standard  deviation  g-=  af-y/n  .  The 
larger  the  sample  size,  the  better  will  be  the  normal 

approximation  to  the  sampling  distribution  of  x  (McClave, 

Benson,  and  Sinich,  1998:254). 
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Test  Heuristic 


As  stated,  the  data  was  originally  categorized  based  on  whether  it  was  deemed  a 
problem  part  as  defined  earlier.  This  is  the  first  case  for  which  an  aggregate  analysis  is 
completed.  The  result  will  allow  an  inference  to  be  made  as  to  whether  a  significant 
difference  exists  between  the  variance  in  ALT  and  PLT  between  problem  parts  and  non¬ 
problem  parts.  The  additional  analyses  are  accomplished  in  order  to  widen  the  scope  of 
this  study. 

The  following  variation  of  the  V-heuristic  is  used  in  conducting  the  two  sample  t- 
test  (Reynolds,  1988): 

( 1 )  Statement  of  the  focus  question. 

(2)  Statement  of  the  hypothesis  being  tested  from  (1). 

(3)  Declare  the  level  of  significance  (a)  under  which  the  test  is  analyzed. 

(4)  State  the  test  statistic,  rejection  region,  and  decision  rule. 

(5)  State  the  statistical  assumptions. 

(6)  Conduct  the  test. 

(7)  Analyze  the  results. 

(8)  Make  an  inference  based  on  the  analysis. 

Comparing  Two  Population  Means 

Focus  Question.  Research  questions  3-8  seek  to  determine  if  sufficient  evidence 
exists  to  conclude  that  there  is  a  difference  between  the  actual  ALT  and  PLT  of  problem 
parts  versus  non-problem  parts,  stock  buy  versus  DVD  items,  and  the  combinations  of 
these  four  categories.  Hence,  a  two-sample  hypothesis  test  is  needed  to  determine  if  the 
mean  of  the  differences  between  the  observed  lead  times  for  each  contracting  action  and 
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the  corresponding  ALTs  and  PLTs  of  record  for  one  category  are  significantly  different 
jfrom  the  mean  of  the  differences  of  the  corresponding  category. 

Statement  of  Hypothesis.  In  order  to  determine  if  the  mean  of  the  differences  for 
the  aggregate  ALT  and  PLT  lead  times  of  one  group  ( Z)  i)  is  statistically  different  from 

the  similarly  defined  mean  for  the  corresponding  group  (£>2),  the  following  hypotheses 
are  tested  for  both  variables: 

Null  Hypothesis  (Ho):  Z)  1  -  £>2  =  £>o 

Alternative  Hypothesis  (Ha):  £)  1  -  £>25*  Do 


Where  D  0  is  the  theoretical  difference  between  the  means,  or  0. 

Significance  Level.  The  observed  significance  level,  or  p- value,  is  used  in  all 
tests.  The  p-value  is  "the  probability  (assuming  Ho  is  true)  of  observing  a  value  of  the 
test  statistic  that  is  at  least  as  contradictory  to  the  null  hypothesis,  and  supportive  of  the 
alternative  hypothesis,  as  the  actual  one  computed  from  the  sample  data"  (McClave, 
Benson,  and  Sinich,  332).  For  the  purposes  of  this  study,  a  p-value  less  than  .05  is 
considered  statistically  significant. 


Test  Statistic,  Rejection  Region,  and  Decision  Rule.  The  test  statistic  for  large 


sample  tests  is  z  = 


D1-D2  -  Do 


.  Since  each  test  is  two-tailed,  the  rejection  region  is  |z| 


^  ^0/25  where  z  0/2  is  based  on  (n-1)  degrees  of  freedom.  Thus,  if  the  calculated  value  of 
the  test  statistic  falls  in  the  rejection,  the  null  is  rejected. 

Assxnnptions.  Since  the  Central  Limit  Theorem  guarantees  an  approximately 


normal  sampling  distribution  of  D ,  no  assumptions  are  necessary.  Steps  six  and  seven 
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of  the  heuristic  are  the  focus  of  Chapter  IV,  and  will  be  discussed  as  that  chapter  unfolds. 
The  inferences  and  conclusions  of  step  eight  are  left  for  Chapter  V. 


Simunarv 

This  chapter  addressed  the  methodology  for  the  forthcoming  data  analysis  in  the 
next  chapter.  All  of  the  assets  chosen  were  consumable  items  for  two  types  of  F-1 6 
engine.  The  particular  NSNs  were  selected  due  to  either  their  categorization  as  problem 
parts  by  item  managers,  or  as  bench  stock.  The  data  for  analyzing  the  variation  of  ALT 
and  PLT  from  the  system  values  utilized  by  the  SAMMS  system  were  obtained  through 
the  DSSC.  Data  were  analyzed  to  determine  if  significant  differences  existed  in  ALT  and 
PLT  in  various  aggregated  categories  using  two-sample  hypothesis  testing. 
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IV.  Analysis  and  Results 


Introduction 

The  hypothesis  tests  described  in  Chapter  III  were  designed  expressly  to  answer 
the  quantitative  research  questions  of  this  study.  To  review,  the  quantitative  based 
research  questions  were: 

1 .  Is  there  a  difference  in  the  distributions  of  deviations  from  system  lead  times 
for  items  classified  as  problem  parts  versus  items  that  are  not  (Case  1)? 

2.  Is  there  a  difference  in  the  distributions  of  deviations  from  system  lead  times 
for  items  purchased  for  stock  repleiushment  versus  direct  vendor  delivery 
(DVD)  contracts  (Case  2)? 

3.  Is  there  a  difference  in  the  distributions  of  deviations  from  system  lead  times 
for  problem  parts  bought  for  stock  replenishment  versus  problem  parts  under 
DVD  contracts  (Case  3)? 

4.  Is  there  a  difference  in  the  distributions  of  deviations  from  system  lead  times 
for  non-problem  parts  bought  for  stock  replenishment  versus  non-problem 
parts  under  DVD  contracts  (Case  4)? 

5.  Is  there  a  difference  in  the  distributions  of  deviations  from  system  lead  times 
for  problem  parts  bought  for  stock  replenishment  versus  non-problem  parts 
bought  for  stock  replenishment  (Case  5)? 
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6.  Is  there  a  difference  in  the  distributions  of  deviations  from  system  lead  times 
for  problem  parts  under  DVD  contracts  versus  non-problem  parts  under  DVD 
contracts  (Case  6)? 

In  order  to  determine  whether  or  not  a  difference  exists  in  the  mean  deviation 
from  the  system  lead  times  for  items  in  the  cases  listed  above,  it  is  necessary  to  perform  a 
two-sample  hypothesis  test  for  each  case.  The  assumption  of  normality  required  for  the 
parametric  tests  performed  in  this  chapter  is  met  via  the  Central  Limit  Theorem,  as 
described  in  Chapter  III.  However,  it  is  necessary  to  analyze  the  original  data  set  in  each 
category  for  outlying  observations. 


Outlier  Analysis 

During  the  preliminary  analysis  some  suspicious  data  was  discovered.  In 
particular,  three  production  lead  time  (PLT)  observations  for  the  same  non-problem  part 
purchased  for  DVD  required  over  2300  days  for  delivery.  Thus,  it  affected  all  of  the 
sample  sets  except  for  cases  3  and  5.  This  most  unusual  observation  was  over  nine 
standard  deviations  from  the  mean  in  case  1,  over  eight  standard  deviations  in  case  2, 
over  seven  standard  deviations  for  cases  4  and  6.  As  an  extreme  outlier,  it  was 
automatically  removed  from  all  cases  where  it  appeared.  The  three  observations 
represented  .333%  of  the  903  total  observations. 

The  other  criterion  used  to  evaluate  outliers  in  the  sample  data  was  the  removal  of 
all  observations  outside  an  interval  of  plus  or  minus  three  standard  deviations  from  the 
mean.  This  interval  was  selected  as  the  capping  point  as  this  theoretically  includes  99 
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percent  of  the  observations  in  a  normal  distribution.  The  capping  of  individual 
observations  is  a  method  of  minimizing  bias  in  the  data  resulting  from  exceptional 
circumstances,  and  is  an  accepted  procedxire  in  defense  inventory  studies.  In  other  words, 
it  is  not  prudent  to  allow  a  small  percentage  of  observations  to  skew  results  that  are  the 
basis  for  strategic  and  operational  management  decisions.  In  fact,  the  Logistics 
Management  Institute  generally  uses  two  standard  deviations  as  a  cap  in  its  inventory 
analyses  (Mattem,  1997:2).  It  should  be  noted  that  removing  outliers  results  in  a  new 
three  standard  deviation  interval,  and  hence,  new  outliers.  However,  further  removal 
jeopardizes  the  original  criterion  of  retaining  99  percent  of  the  observations.  Graphical 
summaries  of  both  lead  times  after  removal  of  the  outliers  are  shown  for  each  case  in 
Appendix  E. 

Table  3  shows  the  number  of  observations  remaining  for  each  data  set  after 
removal  of  multiple  CLINs  and  outliers. 


Table  3.  Sample  sizes 


ALT 

PLT 

ALT 

PLT 

pp 

173 

141 

NPP 

276 

246 

DVD 

193 

164 

STK 

258 

198 

PPDVD 

62 

51 

PPSTK 

111 

92 

NPPDVD 

131 

114 

NPPSTK 

147 

131 

Results 


The  methodology  to  compute  the  test  statistic  was  to  subtract  the  system  lead  time 
from  the  actual  lead  time.  A  mean  deviation  was  then  computed  for  each  of  the  eight 
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categories  shown  in  Table  3,  and  utilized  as  the  test  statistic.  Positive  means  represent 
aggregate  actual  lead  times  that  were  longer  than  the  system  lead  time,  and  negative 
values  represent  those  instances  where  the  aggregate  actual  lead  time  was  shorter  than  the 
system  value.  Table  4  summarizes  the  means  of  the  aggregated  differences  from  the 
system  ALT  and  PLT. 


Table  4.  Summary  of  Means  by  Category 


pALT 

pPLT 

pALT 

pPLT 

Case  1 

PP 

-48.93 

-63.63 

NPP 

-36.72 

-44.65 

Case  2 

DVD 

-82.22 

-11.38 

STK 

-5.12 

-8.67 

Case  3 

PPDVD 

-116.58 

-173.67 

PPSTK 

-11.05 

3.30 

Case  4 

NPPDVD 

-68.96  1 

-85.87 

NPPSTK 

-0.65 

-7.30 

The  hypotheses  being  tested  in  each  case  is  whether  the  mean  of  the  differences 
for  the  aggregate  ALT  and  PLT  lead  times  of  one  group  ( Z)  i)  is  statistically  different 
from  the  similarly  defined  mean  for  the  corresponding  group  ( £>2)-  The  following 
hypotheses  are  tested  for  both  variables: 

Null  Hypothesis  (Ho):  D\  -  Z)  2  =  L)  0 
Alternative  Hypothesis  (Ha):  D\  -  Dq 

Where  5  0  is  the  theoretical  difference  between  the  means,  or  0. 

The  rest  of  this  chapter  discusses  the  analysis  of  the  hypothesis  tests.  While  the 
results  of  the  tests  are  presented  in  simplified  form  in  this  chapter,  complete  results  of  all 
tests  conducted  can  be  found  in  Appendix  F. 
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1 :  Problem  Parts  versus  Non-problem  Parts.  The  issue  explored  in  this  case 
is  whether  or  not  lead  times  deviate  significantly  for  items  classified  as  problem  parts 
versus  those  that  are  not.  Recall  from  Chapter  III  that  an  item  is  termed  a  problem  part 
based  on  the  determination  of  the  item  manager.  All  of  the  problem  parts  in  this  study 
are  on  the  ACC  MICAP  board,  and  thus,  are  affecting  engine  availability.  In  theory, 
longer  than  expected  lead  times  result  in  out  of  stock  conditions,  and  hence,  could 
partially  explain  their  presence  on  the  problem  item  list.  Table  5  shows  the  results  of  the 
two-sample  test  for  problem  part  and  non-problem  part  ALT  and  PLT.  Based  on  the 
results  for  the  test  for  equality  of  variances,  the  unequal  variance  assumption  was 
required  for  both  tests.  The  resulting  p-values  of .  1 369  and .  1 500  are  not  statistically 
significant.  Thus,  there  is  insufficient  evidence  to  reject  the  null  hypotheses  that  the 
mean  aggregate  deviations  of  problem  parts  from  their  system  lead  times  are  significantly 
different  than  the  mean  aggregate  deviations  of  non-problem  parts  from  their  system  lead 
times. 


Table  5.  Two-Sample  T-test  Results,  Case  1 


Variable 

Mean 

Standard 

Deviation 

Standard 

Error 

Test  for  Equality 
of  Variances 

P-value 

PPALT 

-48.93 

93.892 

7.1385 

.0000 

.1369 

NPPALT 

-36.72 

69.603 

4.1896 

PPPLT 

-63.63 

142.23 

r  11.978 

.0000 

.1500 

NPPPLT 

-44.65 

89.594 

5.7123 

Two  interesting  observations  result  from  the  analysis  of  this  case.  The  first 
observation  of  interest  is  the  negative  value  of  the  means  in  all  categories.  Actual  lead 
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times  of  non-problem  parts  averaged  80  days  shorter  than  the  system  value,  while 
problem  part  lead  times  were  approximately  112  days  shorter  than  the  system  value. 
Examining  the  histograms  for  these  categories  reveals  that  these  skews  are  a  result  of  a 
greater  number  of  purchases  received  ahead  of  schedule,  rather  than  the  magnitude  of  the 
negative  tail.  The  negative  values  also  allow  an  inference  related  to  problem  parts.  That 
is,  supplier  lead  times  can  not  be  said  to  be  a  significant  factor,  overall,  in  the 
determination  of  problem  part  status.  Although  the  assets  may  not  be  available  when 
they  are  needed,  which  is  the  primary  concern  of  demand  forecasting,  they  tend  to  arrive 
quicker  than  expected  once  the  acquisition  process  begins. 

The  second  observation  worth  noting  is  the  large  standard  deviations  of  all  four 
samples.  In  fact,  the  minimum  spread  of  the  samples  was  over  415  days  for  non-problem 
part  ALT.  The  extent  of  this  variability  is  seen  clearly  in  Figures  4  and  5.  Although  a 
significant  difference  did  not  exist  in  this  case,  the  large  standard  deviations  provide 
evidence  of  substantial  variability  in  lead  times  for  DLA  consumable  assets. 


Figure  4.  Comparison  of  Distributions  of  Deviations  in  ALT  From  System 
Lead  Times:  Problem  Parts  v  Non-Problem  Parts 
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Case  2:  DVD  versus  Stock  Buv.  This  case  examined  lead  time  deviations  based 
on  the  nature  of  the  purchase.  As  in  Case  1,  all  of  the  sample  observations  were  available 
for  the  analysis.  Table  6  contains  the  results  of  the  two-sample  test  for  the  DVD  and 
stock  buy  categories.  The  unequal  variance  p-value  applied  for  ALT,  while  the  equal 
variance  p-value  was  used  for  PLT.  Nevertheless,  the  p-values  «.05  for  both  ALT  and 
PLT  are  significant.  Consequently,  sufficient  evidence  exists  to  reject  the  null  hypothesis 
in  both  tests,  and  a  significant  difference  can  be  said  to  exist  between  the  mean  of  the 
deviations  from  the  system  lead  times. 


Figure  5.  Comparison  of  Distributions  of  Deviations  in  PLT  From  System 
Lead  Times:  Problem  Parts  v  Non-Problem  Parts 


Given  the  expedited  nature  of  many  DVD  purchases,  this  result  is  not  surprising. 
However,  the  means  and  standard  deviations  are  again  worth  noting.  The  data  suggests 
that  the  average  ALT  for  DVD  items  is  82  days  shorter  than  the  expected  value  under 
stock  replenishment  contracts.  Similarly,  PLT  for  DVD  items  is  1 1 1  days  shorter  than 
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expected  in  a  stock  replenishment  Thus,  the  DVD  process  reduced  total  acquisition  lead 
time  (TALT)  by  approximately  193  days.  In  terms  of  stock  replenishment  items,  the 
weighted  average  was  exceptionally  accurate.  Actual  lead  times  deviated  from  the 
system  ALT  and  PLT  by  under  six  and  nine  days,  respectively.  However,  this  result  must 
be  qualified  as  50  percent  of  the  deviations  are  in  excess  of  the  means,  and  the  standard 
deviations  for  both  ALT  and  PLT  of  stock  replenishment  purchases  were  over  85  days. 
Hence,  the  longer  lead  times,  as  shown  in  the  upper  tails  of  Figures  6  and  7,  are  potential 
causes  of  future  problem  items,  or,  if  this  variability  is  being  captured  in  the  reorder 
point,  they  are  to  some  extent  contributing  to  excess  inventory. 


Table  6.  Two-Sample  T-test  Results,  Case  2 


Variable 

Mean 

Standard 

Deviation 

Standard 

Error 

Test  for  Equality 
of  Variances 

P-value 

DVDALT 

-82.22 

50.672 

3.6474 

.0000 

.0000 

STKALT 

-5.12 

85.099 

5.298 

DVDPLT 

-111.38 

90.043 

7.0312 

.0518 

BOB 

101.83 

7.2364 
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DAYS 


Figure  6.  Comparison  of  Distributions  of  Deviations  in  ALT  From  System 
Lead  Times:  DVD  v  Stock  Replenishment 


DAYS 


Figure  7.  Comparison  of  Distributions  of  Deviations  in  PLT  From  System 
Lead  Times:  DVD  v  Stock  Replenishment 


Case  3:  Problem  Parts  for  DVD  versus  Problem  Parts  for  Stock  Buv.  Case  3  sub¬ 
divides  the  problem  part  category  to  determine  if  a  difference  exists  within  problem  parts 
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between  DVD  and  stock  replenishment  purchases.  Although  this  division  reduced  die 
sample  sizes  by  over  50  percent,  the  remaining  observations  still  yielded  an  n  sufficient 
to  invoke  the  Central  Limit  Theorem.  Additionally,  since  DVD  and  stock  replenishment 
lead  times  are  from  separate  populations,  any  inferences  drawn  must  be  in  relation  to  the 
individual  effect  of  contract  type  on  problem  parts.  Furthermore,  for  the  DVD  category, 
the  deviations  are  relative  to  the  system  lead  times  for  stock  replenishment,  and  any 
inferences  must  be  compared  to  expected  stock  replenishment  lead  times 

The  results  of  the  statistical  tests  for  Case  3  are  shown  in  Table  7.  Based  on  the 
results  for  the  tests  for  equality  of  variances,  the  unequal  variance  assumption  was  used 
in  both  tests.  The  resulting  p-values  were  less  than  .0000  for  both  ALT  and  PLT.  Thus, 
sufficient  evidence  exists  to  conclude  that  the  differences  of  the  means  of  the  deviations 
from  the  system  lead  times  are  not  equal. 


Table  7.  Two-Sample  T-test  Results,  Case  3 


Variable 

Mean 

Standard 

Deviation 

Standard 

Error 

Test  for  Equality 
of  Variances 

P-value 

PPDVDALT 

-116.58 

66.054 

8.3889 

.0139 

.0000 

PPSTBCALT 

-11.05 

85.60 

8.1248 

PPDVDPLT 

-173.67 

94.082 

13.174 

.0009 

.0000 

PPSTKPLT 

3.3043 

142.32 

14.838 

In  the  search  to  determine  a  link  between  lead  time  and  problem  parts.  Case  3 
demonstrates  rather  decisively  that  the  primary  driver  of  an  asset  being  declared  a 
problem  part  is  not  related  to  supplier  lead  times.  In  each  of  the  classifications  in  this 
case,  only  the  aggregated  PLT  of  stock  replenishment  items  was  longer  than  the 
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expected,  and  then  by  a  marginal  amount  of  time.  Case  3  does  indicate,  as  shown  in 
Figures  8  and  9,  that  two  very  separate  lead  time  populations  do  exist  between  DVD  and 
stock  replenishment  contracts. 

Finally,  an  interesting  comparison  can  be  made  between  problem  parts  under 
DVD  contracts  versus  all  DVD  contracts.  The  ALT  of  problem  parts  under  DVD 
contracts  is  34  days  less,  or  quicker,  than  that  of  all  DVD  items.  More  significantly,  the 
PLT  for  problem  parts  bought  under  DVD  contracts  is  62  days  shorter  than  that  of  all 
DVD  items.  Thus,  it  can  be  seen  that  the  various  pressures  and  rewards  applied 
throughout  the  acquisition  cycle  result  in  a  significant  improvement  in  lead  times  for 
problem  parts. 


Figure  8.  Comparison  of  Distributions  of  Deviations  in  ALT  From  System  Lead  Times: 
Problem  Part  DVD  v  Problem  Part  Stock  Replenishment 
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Figiire  9.  Comparison  of  Distributions  of  Deviations  in  PLT  From  System  Lead  Times: 
Problem  Part  DVD  v  Problem  Part  Stock  Replenishment 


Case  4:  Non-problem  Parts  for  DVD  versus  Non-problem  Parts  for  Stock  Buy. 
Case  4  provides  further  evidence  of  the  significant  variability  experienced  in  consumable 
item  lead  times.  The  same  restrictions  apply  in  this  case  in  relation  to  inferences  drawn 
as  in  Case  3.  Table  8  shows  the  results  of  the  two-sample  test  for  non-problem  part  DVD 
and  non-problem  part  stock  replenishment.  As  in  Case  2,  the  ALT  test  required  the 
unequal  variance  p-value,  and  the  PLT  test  used  the  equal  variance  p-value.  The 
resulting  p- values  « .0000  for  the  both  the  tests  provide  sufficient  evidence  to  reject  the 
null  hypotheses. 

Case  4  confirms  that  the  true  difference  between  problem  parts  and  non-problem 
parts  lies  in  the  type  of  contract.  ALT  and  PLT  for  non-problem  parts  under  DVD 
contracts  is  at  least  two  months  quicker  than  the  expected  imder  stock  replenishment 
contracts.  On  the  other  hand,  TALT  for  non-problem  items  bought  for  stock  is  eight  days 
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shorter  than  forecasted.  FigureslO  and  1 1  demonstrate  that  the  distinct  difference  in  lead 
times  between  the  contract  types  is  also  present  in  this  category. 


Table  8.  Two-Sample  T-test  Results,  Case  4 


Variable 

Mean 

Standard 

Deviation 

Standard 

Error 

Test  for  Equality 
of  Variances 

P-value 

NPPDVDALT 

-68.96 

36.275 

3.1693 

.0000 

.0000 

NPPSTKALT 

84.633 

6.9804 

NPPDVDPLT 

78.399 

7.3428 

.3410 

.0000 

NPPSTKPLT 

-7.30 

r  81.415 

7.1132 

Figure  10.  Comparison  of  Distributions  of  Deviations  in  ALT  From  System  Lead  Times: 
Non-Problem  Part  DVD  v  Non-Problem  Part  Stock  Replenishment 
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Figxire  1 1 .  Comparison  of  Distributions  of  Deviations  in  PLT  From  System  Lead  Times: 

Non-Problem  Part  DVD  v  Non-Problem  Part  Stock  Replenishment 

Case  5:  Problem  Parts  for  Stock  Buv  versus  Non-problem  Parts  for  Stock  Buy.  To 
complete  the  analysis  of  the  sample  data,  the  type  of  purchase  was  kept  constant  in  Cases 
5  and  6,  and  problem  parts  were  again  compared  to  non-problem  parts.  Table  9  shows 
the  results  of  the  two-sample  test  for  problem  part  and  non-problem  part  lead  times  under 
a  stock  replenishment  acquisition.  In  this  case  ALTs  met  the  equality  of  variances  test  at 
the  .05  level  of  significance.  The  imequal  variance  p-value  was  used  for  PLT.  The 
resulting  p-values  were  .3316  for  ALT  and  .5279  for  PLT.  Therefore,  the  null  hypotheses 
are  rejected  for  both  ALT  and  PLT. 

As  seen  in  Figures  12  and  13,  the  distributions  of  the  deviations  for  problem  parts 
and  non-problem  parts  are  remarkably  similar.  Additionally,  the  weighted  average 
approach  is  reaffirmed  as  an  accurate  method  of  computing  lead  times,  however,  this  is 
qualified  as  in  Case  2  due  to  the  large  standard  deviations  exhibited. 
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Table  9.  Two-Sample  T-test  Results,  Case  5 


Variable 

Mean 

Standard 

Deviation 

Standard 

Error 

Test  for  Equality 
of  Variances 

P-value 

PPSTKALT 

-11.05 

85.60 

8.1248 

.4461 

.3316 

NPPSTKALT 

-0.65 

84.633 

6.9804 

PPSTKPLT 

142.32 

14.838 

.0000 

.5279 

NPPSTKPLT 

-7.30 

81.415 

7.1132 

DAYS 

Figure  12.  Comparison  of  Distributions  of  Deviations  in  ALT  From  System  Lead  Times: 
Problem  Part  Stock  Replenishment  v  Non-Problem  Part  Stock  Replenishment 


DAYS 


Figure  13.  Comparison  of  Distributions  of  Deviations  in  PLT  From  System  Lead  Times: 
Problem  Part  Stock  Replenishment  v  Non-Problem  Part  Stock  Replenishment 
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Case  6:  Problem  Parts  for  DVD  versus  Non-problem  Parts  for  DVD.  In  Case  6, 


problem  parts  and  non-problem  parts  purchased  for  DVD  are  examined.  Again,  the 
results  are  presented  as  a  comparison  to  expected  values  under  stock  replenishment 
contracts.  Table  10  shows  the  results  of  the  two-sample  t-test.  Using  the  unequal 
variance  p-value  for  ALT  and  the  equal  variance  p-value  for  PLT,  the  resulting  p- values 
« .0000  in  both  tests  provide  sufficient  evidence  to  reject  the  null  hypotheses.  Thus,  a 
significant  difference  between  the  differences  of  the  means  of  the  deviations  from  the 
system  lead  times  does  exist. 


Table  10.  Two-Sample  T-test  Results,  Case  6 


Variable 

Standard 

Deviation 

Standard 

Error 

Test  for  Equality 
of  Variances 

P-value 

PPDVDALT 

-116.58 

66.054 

8.3889 

.0000 

.0000 

NPPDVDALT 

36.275 

3.1693 

PPDVDPLT 

-173.67 

94.082 

.0574 

.0000 

NPPDVDPLT 

7.3428 

This  case  serves  to  reemphasize  the  impact  of  DVD  on  lead  time.  Regardless  of 
the  classification  of  the  asset,  parts  under  DVD  contracts  experience  considerably 
accelerated  lead  times.  Moreover,  a  significant  difference  exists  between  problem  parts 
and  non-problem  parts  within  the  DVD  category.  Thus,  it  appears  problem  parts  receive 
additional  attention  in  both  lead  time  components  of  the  acquisitions  process.  The 
profound  deviations  from  the  forecasted  values  are  shown  in  Figures  14  and  15. 
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OBSERVATION  >n  OBSERVATION 


igure  14.  Comparison  of  Distributions  of  Deviations  in  ALT  From  System 
Lead  Times:  Problem  Parts  DVD  v  Non-Problem  Parts  DVD 
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Figure  15.  Comparison  of  Distributions  of  Deviations  in  PLT  From  System 
Lead  Times:  Problem  Parts  DVD  v  Non-Problem  Parts  DVD 
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Summary 


The  analysis  of  sample  data  demonstrated  that  the  weighted  average  method  of 
determining  lead  times  for  stock  replenishment  items  performed  well  over  the  aggregate 
data,  However,  particularly  large  standard  deviations  in  the  differences  from  the  system 
values  temper  this  finding.  To  some  extent,  lead  times  significantly  shorter  than  the 
system  value  used  in  requirements  computations  are  contributing  to  excess  inventory 
levels.  In  terms  of  problem  parts,  the  analysis  suggested  that  lead  times  are  not 
significant  contributors  to  the  initial  determination  of  an  asset  being  a  problem  part.  This 
finding  can  be  generalized  to  individual  parts  as  very  few  assets  classified  as  problem 
parts  had  excessively  large  positive  deviations. 

In  terms  of  the  variables  considered  in  this  study,  the  type  of  purchase  was  shown 
to  the  primary  differentiating  factor.  Both  ALT  and  PLT  were  significantly  reduced 
when  the  part  was  purchased  under  a  DVD  contract.  The  distinction  between  problem 
parts  and  non-problem  parts  generated  significant  differences  only  in  terms  of  DVD 
contracts.  Case  6  revealed  that  under  DVD,  actual  lead  times  for  problem  parts  averaged 
47  and  88  days  faster  than  non-problem  parts  for  ALT  and  PLT,  respectively.  Finally, 
observations  of  means  and  standard  deviations  yielded  a  strong  indication  of  substantial 
variability  in  actual  lead  times. 

In  this  research  effort,  eight  classifications  of  parts  were  examined  for  ALT  and 
PLT,  resulting  in  a  total  of  16  mean  differences.  As  previously  shown  in  table  4,  seven 
categories  had  a  mean  deviation  from  file  system  lead  time  of  less  than  two  weeks.  Six  of 
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these  were  localized  to  the  stock  replenishment  category,  and  eight  of  the  remaining  nine 
categories,  all  DVD,  had  average  lead  times  accelerated  by  over  seven  weeks. 

Chapter  V  provides  a  summary  of  this  study,  conclusions  regarding  each  of  the 
investigative  questions,  and  discusses  potential  areas  of  further  research  in  the  area  of 
consumable  item  lead  times. 
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V.  Conclusion  and  Recommendations 


Introduction 

The  accurate  computation  of  requirements  for  spare  parts  is  a  critical  component 
of  military  logistics.  The  effectiveness  of  such  computations  is  heavily  dependent  on  a 
multitude  of  variables,  one  of  which  is  total  acquisition  lead  time  (TALT).  Simply  stated, 
TALT  is  the  length  of  time  between  the  date  the  purchase  request  is  initiated  and  receipt 
of  the  order.  This  time  period  is  utilized  to  compute  the  inventory  level,  or  reorder  point, 
at  which  the  acquisition  process  should  begin  in  order  satisfy  the  expected  demands 
during  TALT.  Inaccurate  lead  times  can  result  in  inaccurate  reorder  points.  The 
consequences  of  erroneous  reorder  points  are  either  too  much  or  too  little  stock  relative  to 
demand.  Both  of  these  conditions  directly  affect  weapon  system  readiness  through 
misallocation  of  supply  dollars  or  work  stoppages. 

The  two  classifications  of  spares  in  the  Air  Force  are  reparables  and  consumables. 
Chapter  II  established  the  importance  of  consumable  items  in  terms  of  management 
efficiency  and  weapon  system  readiness  within  the  Department  of  Defense.  Chapters  III 
and  IV  examined  the  variability  experienced  in  TALT  among  various  classifications  of 
consumable  items.  This  chapter  collects  the  findings  of  the  previous  chapters  to  answer 
the  management  and  research  questions  posed  in  this  study. 
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Conclusions 


This  section  restates  each  research  question  along  with  the  conclusions  reached 
based  on  the  information  presented  throughout  this  study. 

].  What  is  the  impact  of  lead-time  variability  on  consumable  item  inventory  levels  in  the 
DoD? 

Chapter  II  discussed  the  theoretical  foundation  of  the  EOQ  model  and  the 
function  of  lead  time  in  DoD  requirements  computations.  Lead  time  variability  directly 
impacts  safety  stock  calculations  and  pipeline  quantity,  which  are  two  factors  in 
determining  the  reorder  point  of  an  asset.  Reorder  points  higher  than  necessary  result  in 
the  misallocation  of  funds  through  the  premature  purchase  of  assets,  while  artificially  low 
reorder  points  result  in  lower  inventory  levels,  that  could  affect  weapon  system  readiness 
through  work  stoppages.  The  acquisition  of  consumable  items  at  DLA  does  experience  a 
high  degree  of  lead  time  variability.  To  some  extent,  this  variability,  in  particular  stock 
replenishment  purchases  in  the  range  of  one  to  two  standard  deviations  may  be  affecting 
reorder  points,  and  hence,  be  contributing  to  the  problem  of  excess  inventory  that  the 
General  Accounting  Office  has  repeatedly  criticized  in  its  reports. 

2.  What  methodology  does  DLA  use  to  assign  lead  times  to  assets? 

Chapter  II  also  examined  DLA  methodology  for  consumable  requirements 
computations.  DLA  updates  lead  times  weekly  using  a  simple  weighted  average  for  both 
administrative  lead  time  and  production  lead  time.  Although  exceptions  do  occur,  the 
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standard  computation  for  determining  a  new  lead  time  is  the  sum  of  67  percent  of  the 
latest  lead  time  and  33  percent  of  the  previous  lead  time. 

5.  Is  there  a  difference  in  variability  of  lead  times  for  items  classified  as  problem  parts 
versus  items  that  are  not  (Case  1)? 

The  results  of  the  hypothesis  test  on  the  aggregated  data  showed  insufficient 
evidence  to  conclude  that  a  significant  difference  existed  between  the  mean  of  the 
deviations  of  problem  parts,  including  those  imder  DVD  contracts,  and  the  mean  of  the 
deviations  of  non-problem  parts  from  their  respective  system  lead  times.  While 
individual  items  of  either  category  can  experience  lead  times  well  in  excess  of  the  system 
lead  time,  these  cases  are  generally  confined  to  stock  replenishment  contracts.  Therefore, 
the  conclusion  can  be  drawn  that  lead  time  is  not  a  major  contributor  to  problem  parts  as 
a  whole. 

The  two  categories  in  Case  1,  which  included  the  entire  set  of  sample  data, 
displayed  large  standard  deviations.  Although  no  statistically  significant  difference 
between  the  two  categories  was  evident,  in  terms  of  the  broader  issue  of  lead  time 
variability,  substantial  variability  exists  in  TALT  for  consumable  items.  After  the 
removal  of  outlying  observations,  the  maximum  deviations  in  ALT  were  247  days  in 
excess  and  294  days  ahead  of  the  forecasted  lead  time.  For  PLT,  the  maximum 
deviations  were  419  days  and  413  days,  respectively,  and  both  were  observed  in  the 
problem  parts  category.  This  leads  to  the  inference  that  the  degree  of  variability  in 
production  lead  time  contributes,  on  an  individual  basis,  to  the  classification  of  items  as 
problem  parts. 
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4.  Is  there  a  difference  in  variability  of  lead  times  for  items  purchased  for  stock 
replenishment  versus  direct  vendor  delivery  (Case  2)? 

This  hypothesis  test  yielded  sufficient  evidence  to  conclude,  for  both  ALT  and 
PLT,  that  a  significant  difference  does  exist  between  these  categories  in  their  mean  of  the 
deviations  firom  the  programmed  lead  times.  Most  notably,  TALT  of  direct  vendor 
delivery  items  averaged  193  days  faster  than  expected  imder  stock  replenishment  buys. 

The  weighted  average  method  proved  accurate  for  stock  replenishment  parts, 
which  averaged  14  days  shorter  than  the  system  value.  From  a  statistical  standpoint, 
approximately  50  percent  of  the  actual  lead  times  had  positive  deviations,  equating  to 
lead  times  in  excess  of  the  system  value.  This  may  result  in  a  slight  increase  in  inventory 
levels,  however,  given  the  cost  of  consumable  items,  the  fi-equency  of  purchase,  and  the 
simplicity  of  the  weighted  average  forecast,  a  14-day  acceleration  can  not  be  considered  a 
significant  problem.  However,  the  high  variability  of  stock  replenishment  lead  times 
must  be  suspected  of  increasing  inventory  levels,  or  causing  stockout  conditions  to  some 
extent.  Quantifying  this  impact  is  left  for  future  research. 

5.  Is  there  a  difference  in  variability  of  lead  times  for  problem  parts  bought  for  stock 
replenishment  versus  problem  parts  that  are  DVD  (Case  3)? 

Within  the  category  of  problem  parts,  the  differences  of  the  means  of  the 
deviations  from  the  system  lead  times  between  DVD  and  stock  replenishment  items  was 
significant.  This  result  is  not  surprising  due  to  the  dominating  effect  of  DVD  that  was 
observed  in  Case  2.  Problem  parts  imder  DVD  contracts  also  had  the  largest  deviation  in 
TALT,  almost  290  days  faster  than  the  stock  replenishment  TALT.  This  nine-month 
improvement  in  lead  time  demonstrates  the  benefit  of  contracting  under  DVD  for 
problem  parts.  However,  if  the  DVD  contract  was  let  because  an  item  was  a  problem 
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part,  this  accelerated  lead  time  will  not  eliminate  the  original  cause,  which  may  be  the 
high  degree  of  variability  this  study  uncovered.  Thus,  from  the  aggregate  perspective, 
ALT  and  PLT  can  not  be  considered  one  of  the  causes  of  an  item  being  classified  as  a 
problem  part,  but  their  variability  is  certainly  suspect. 

6.  Is  there  a  difference  in  variability  of  lead  times  for  non-problem  parts  bought  for 
stock  replenishment  versus  non-problem  parts  that  are  DVD  (Case  4)? 

Case  4  compared  non-problem  parts  using  type  of  purchase  as  the  independent 
variable.  In  this  case,  sufficient  evidence  again  existed  to  reject  the  null  hypothesis  for 
both  ALT  and  PLT.  Here,  the  weighted  average  approach  again  proved  accurate,  with 
actual  lead  times  for  stock  replenishment  items  within  one  week  of  the  system  values. 
The  effectiveness  of  DVD  contracts  was  also  evidence  through  a  155  day  acceleration  in 
TALT. 

7.  Is  there  a  difference  in  variability  of  lead  times  for  problem  parts  bought  for  stock 
replenishment  versus  non-problem  parts  bought  for  stock  replenishment  (Case  5)? 

Case  5  tested  the  variability  of  stock  replenishment  purchases  across  the 
categories  of  problem  parts  and  non-problem  parts.  The  statistical  test  showed  no 
significant  difference  in  the  mean  differences  for  either  ALT  or  PLT.  This  result  reveals 
that  little  difference  exists  in  the  lead  times  of  problem  parts  and  non-problem  parts  for 
stock  replenishment.  Additionally,  this  case  demonstrated  the  accuracy  of  the  weighted 
average  forecast  for  stock  replenishment.  Considering  the  sizable  standard  deviations, 
the  degree  of  the  accuracy  observed  is  somewhat  surprising.  With  regard  to  stock 
replenishment  contracts,  the  conclusions  can  be  drawn  that  lead  times  are  not 
significantly  contributing  to  the  excess  inventory  in  DL  A,  and  the  weighted  average 
forecast  is  performing  effectively. 
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8.  Is  there  a  difference  in  variability  of  lead  times  for  problem  parts  bought  for  DVD 
versus  non-problem  parts  that  are  DVD  (Case  6)? 

Case  6  tested  problem  parts  and  non-problem  parts  purchased  under  DVD 
contracts.  A  significant  difference  did  exist  in  both  tests  between  the  differences  of  the 
means  of  the  deviations  from  the  forecasted  lead  times.  The  statistical  analysis  of  this 
case  offered  further  insight  into  the  impact  of  DVD  on  lead  time.  Average  ALTs  of  both 
categories  were  at  least  68  days  faster  than  system  values  for  stock  replenishment.  In 
terms  of  PLT,  problem  parts  were  received  173  days  faster  than  expected,  and  non¬ 
problem  parts  averaged  85  days  shorter  in  the  PLT  cycle. 

Summary  of  Findings 

Three  primary  conclusions  can  be  reached  based  on  the  qualitative  and 
quantitative  information  provided  in  this  study.  The  first  two  relate  to  the  specific  issues 
addressed  in  the  management  questions  presented  in  Chapter  I,  while  the  third  confirms 
the  performance  of  DVD  contracts. 

The  first  problem  explored  by  this  research  effort  was  whether  inaccurate  lead 
time  determination  was  a  contributing  factor  in  the  classification  of  parts  as  problem 
items.  Relative  to  the  entire  class  of  problem  parts,  the  answer  is  a  cautious  no.  Overall, 
ALT  and  PLT  of  problem  parts  was  approximately  49  days  and  64  days  faster  than  the 
system  lead  times,  respectively.  When  analyzed  based  on  type  of  purchase,  the 
aggregated  mean  deviation  in  TALT  of  problem  parts  under  DVD  contracts  was  290  days 
faster  than  expected.  On  the  other  hand,  ALT  of  problem  parts  purchased  for  stock 
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replenishment  averaged  only  1 1  days  faster  than  expected,  and  PLT  averaged  3  days 
slower. 

All  of  these  figures  must  be  considered  in  their  context  as  averages  in  samples 
that  experience  considerable  variability.  Although  these  deviations  may  not  seem 
significant,  approximately  50  percent  of  items  had  lead  times  in  excess  of  these  averages. 
Therefore,  on  an  individual  basis,  there  is  cause  to  suspect  unusually  long  lead  times  to 
be  a  contributing  factor  in  problem  parts.  The  only  instance  where  this  issue  seems  to  be 
eliminated  is  the  case  of  DVD  contracts,  where  unusually  long  lead  times  are  noticeably 
rare  occurrences. 

The  second  problem  addressed  was  the  accuracy  of  the  system  lead  times  utilized 
by  DLA  in  relation  to  the  actual  lead  times  experienced  in  the  acquisitions  process.  The 
findings  in  this  Study  support  the  conclusion  that  sufficient  variability  exists  in  both  ALT 
and  PLT  to  at  least  warrant  further  efforts  to  reduce  this  variability  through  close 
cooperation  with  suppliers.  The  minimum  standard  deviation  in  the  sixteen  sample  sets 
was  36  days,  and  most  were  over  80  days.  Although  the  excessive  deviations  were  not 
confined  to  any  particular  category  of  asset,  the  weighted  average  used  to  determine 
system  lead  times  are  taken  from  the  prior  two  representative  contracting  actions.  Hence, 
if  the  last  two  procurements  of  an  asset  were  for  stock  replenishment,  and  the  lead  times 
were  particularly  long,  the  newly  computed  reorder  point  will  be  artificially  high,  and 
DLA  will  accumulate  some  excess  inventory. 

This  study  also  confirmed,  from  a  statistical  viewpoint,  the  dramatic  reduction  in 
lead  time  that  occurs  with  DVD  contracts.  Relative  to  DLA  inventory,  the  importance  of 
this  reduction  is  only  seen  in  light  of  its  increased  use  of  DVD  contracts.  The  greater  use 
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of  DVD  should  equate  to  lower  inventory  levels  for  DLA  as  suppliers  directly  fill  field 
requirements.  The  question  then  becomes  how  much  safety  stock  should  DLA  hold  in 
order  to  meet  demands  during  DVD  lead  times. 


Recommendations  for  Future  Research 

Several  ideas  arose  during  the  course  of  this  study,  which  create  opportunities  for 
follow-on  research.  This  study  could  easily  be  expanded  using  a  greater  number  of  stock 
numbers  across  a  larger  number  of  weapon  systems  or  end  items.  This  would  greatly 
increase  the  extent  to  which  this  analysis  can  be  generalized. 

Another  possible  extension  is  the  change  in  the  cost  of  safety  stock,  given  DVD 
lead  times  and  the  percentage  of  demands  for  particular  assets  filled  through  DVD.  This 
could  be  accomplished  empirically,  through  the  use  of  actual  transaction  histories  used  to 
recreate  the  inventory  cycle  using  recalculated  reorder  points  based  on  the  two  factors 
listed  above.  Any  recommended  buy  date  serves  well  as  an  initial  reorder  date  as  long  as 
the  inventory  position  of  the  asset  on  that  date  is  known. 

A  third  potential  research  effort  is  a  regression  analysis  to  analyze  the  impact  of 
other  variables  such  as  specific  type  of  contract,  weapon  system  or  end-item,  and 
dimimshing  manufacturing  sources  and  material  shortages.  Similar  analyses  has  already 
been  accomplished  in  the  area  of  reparable  components,  but  as  yet,  is  left  incomplete  for 
consumable  items. 
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Summary 


The  overriding  purpose  of  this  study  was  to  examine  lead  time  variability  for 
consumable  items  in  the  Air  Force  wholesale  supply  system.  DLA  manages  the  majority 
of  these  assets,  and  is  caught  between  end  users  clamoring  for  support  to  maintain  the 
readiness  of  its  weapon  systems,  and  congressional  oversight  committees  continually 
criticizing  the  dollar  value  of  excess  inventory.  This  study  examined  a  small  piece  of  an 
extremely  complex  environment  in  order  to  determine  if  there  was  sufficient  reason  to 
mine  further  into  the  lead  time  issue. 

Overall,  the  weighted  average  forecasting  method  used  by  DLA  tended  to 
accmately  reflect  actual  lead  times.  Lead  times  of  problem  parts  were  not  foimd  to  be 
significantly  different  from  those  of  non-problem  parts,  except  within  the  category  of 
DVD  contracts.  The  limitations  of  this  study  in  terms  of  generalizing  the  findings  were 
discussed  and  recommendations  for  future  research  were  suggested. 
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Appendix  A:  SuddIv  Codes 


ITEM  CATEGORY  CODE  (ICC) 

Code  Definition 

P  Replenishment  Demand  Type  Item  (program  oriented)  -  an  item  for  which 

demand  forecasts  are  balsed  on  program  data  as  well  as  historical  demand  data. 

1  Replenishment  Demand  Type  Item  (demand  oriented)  -  an  item  for  which  demand 
forecasts  are  based  on  historical  demand  data. 

(DLAM  4140.2, 1965:Vol.II,  Part  3,  Appendix  A-87) 


STANDARDIZATION  STATUS  CODE  (STDZ,  SSC) 


Code  Term 
3  Item  not 
authorized 
for  pmchase 


Explanation 

An  item,  which  as  a  result  of  a  formal  item  reduction  study, 
is  accepted  as  not  authorized  for  purchase 


E  Item  not 
authorized 
for  purchase 


An  item  no  longer  authorized  for  purchase  which  has  been 
replaced  by  a  new  item  as  the  result  of  new  or  revised 
superseding  specifications  or  standards  being  promulgated. 


(DLAM  4140.2, 1965:Vol.II,  Part  3,  Appendix  A-101) 


SUPPLY  STATUS  CODES  (SSC) 

Code  Term  Explanation 

6  Terminal,  Item  in  stock  and  being  issued  until  exhausted. 
Stocked  Not  authorized  for  future  procurement. 

(DLAM  4140.2, 1965:Vol.II,  Part  3,  Appendix  A-50) 
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Appendix  B:  Air  Force  Materiel  Command  Readiness  Assessment  Module  Reports 


FY98  Air  Force  MICAP  Incidents 


DATE:  08/09/99  -  14.12.21  C.T.  D165B-MIC  :  08/08/99 
AGGREGATE  SUMMARY  REPORT  FOR  D165B-MICAP  HISTORY 
SUBSETS  SELECTED:  MONTH:  97/10-98/09 


Command 

Opening 

MICAP 

Incidents 

Active 

MICAP 

Incidents 

Closing 

MICAP 

Incidents 

MICAP 
Period  Hours 

0 

1 

1 

121 

AAC 

0 

0 

0 

0 

AAG 

5 

6 

5 

1585 

ACC 

124342 

127792 

123933 

37303845 

ADC 

14 

15 

15 

4443 

AET 

55686 

57210 

54999 

20307693 

5095 


3239 


45 


7257 


116924 


62 


6 


119 


99 


60 


6 


325 


0 


1211 


28 


FY98  Air  Force  MICAP  Incidents  (Continued) 


Command 

Opening 

MICAP 

Incidents 

Active 

MICAP 

Incidents 

Closing 

MICAP 

Incidents 

MICAP 
Period  Hours 

MAP 

1 

1 

1 

119 

MEA 

167 

179 

170 

48956 

MIF 

9 

9 

9 

1500 

MPC 

6 

6 

6 

1348 

MTC 

20029 

15266533 

OAF 

24 

28 

26 

5310 

OAR 

1 

1 

1 

25 

OFG 

6 

7 

6 

3773 

OSI 

1 

1 

1 

46 

OTE 

9 

9 

9 

448 

OUS 

10 

10 

10 

411 

PAF 

32211 

33209 

32149 

10200892 

RBO 

1 

1 

1 

154 

RED 

54 

67 

65 

47472 

SOC 

9797 

10080 

9805 

2709830 

SPC 

2477 

2578 

2487 

708844 

TAG 

0 

1 

0 

8760 

TAP 

6 

6 

6 

3001 

USS 

28 

32 

31 

13675 

Total 

457319 

470221 

454369 

140559191 

72 


F Y98  MICAP  Incidents  for  DLA  Managed  Items 


DATE:  08/09/99  -  13.47.45  C.T.  D165B-MIC  :  08/08/99 
AGGREGATE  SUMMARY  REPORT  FOR  D165B-MICAP  HISTORY 
SUBSETS  SELECTED:  MONTH:  97/10-98/09;  SOURCE  OF  SUPPLY: 

S9E,S9F,S9G,S9I,S9T  _ 


Command 


ACC 


ADC 


AET 


AFA 


AFC 


AFE 


AFR 


AIC 


AMC 


ANG 


CAF 


CMS 


CNT 


CON 


CSV 


HAF 


ICT 


ISC 


MEA 


MIF 


MPC 


MTC 


OAF 


OFG 


OTE 


OUS 


PAF 


RED 


SOC 


SPC 


TAP 


uss 


Total 


Opening 

MICAP 

Incidents 


31883 


5 


13673 


1 


2 


7183 


9728 


2 


14537 


37042 


Active 

MICAP 

Incidents 


32885 


5 


14095 


1 


2 


7401 


9956 


2 


15168 


37783 


Closing 

MICAP 

Incidents 


31825 


5 


13421 


1 


2 


6997 


9660 


2 


14310 


36812 


132856 


136930 


131360 


MICAP 

Period 

Hours 


9304986 


1385 


5646480 


49 


661 


2850220 


2257406 


133 


6093652 


8370856 


661 


3795 


24117 


26703 


3414 


122 


0 


180 


21348 


436 


252 


4844121 


1368 


287 


176 


153 


3074066 


32398 


917071 


127682 


2392 


6644 


43613214 
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FY98  MICAP  Incidents  for  Consumable  Items 


DATE:  08/09/99  - 13.42.14  C.T.  D165B-MIC  :  08/08/99 
AGGREGATE  SUMMARY  REPORT  FOR  D165B-MICAP  fflSTORY 
SUBSETS  SELECTED:  MONTH:  97/10-98/09;  ERRC:  N 


Command 

Opening 

MICAP 

Incidents 

Active 

MICAP 

Incidents 

Closing 

MICAP 

Incidents 

MICAP 

Period 

Hours 

AAG 

1 

1 

0 

735 

ACC 

50718 

51933 

50591 

12970583 

ADC 

9 

9 

9 

1875 

AET 

20412 

20868 

20232 

6478621 

AFA 

1 

1 

1 

49 

AFC 

2 

2 

2 

245 

AFE 

10918 

11231 

10685 

3936780 

AFR 

13693 

13974 

13637 

2759961 

AFT 

1 

1 

1 

7 

AIC 

2 

2 

2 

191 

21527 

22297 

21378 

7731290 

ANG 

51961 

52903 

51712 

11022425 

AUN 

0 

1 

0 

4331 

CAF 

9 

9 

9 

827 

CML 

0 

0 

0 

0 

CMS 

9 

7 

4022 

CNT 

375 

378 

377 

43366 

CON 

125 

129 

125 

39309 

CSV 

16 

16 

16 

1247 

GAF 

1 

1 

1 

6 

HAF 

0 

1 

1 

21 

ISC 

3 

r  3 

3 

274 

MEA 

82 

88 

84 

22652 

MIF 

5 

5 

5 

1128 

MPC 

2 

2 

2 

259 

MTC 

7641 

8027 

7147 

5273318 

OAF 

11 

12 

12 

2452 

OFG 

2 

3 

2 

2293 

OSI 

1 

1 

1 

46 

OTE 

4 

4 

4 

176 

OUS 

4 

4 

4 

183 

PAF 

15485 

15938 

15445 

4358027 

RED 

31 

40 

39 
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FY98  MICAP  Incidents  for  Consumable  Items  (Continued) 


Command 

Opening 

MICAP 

Incidents 

Active 

MICAP 

Incidents 

Closing 

MICAP 

Incidents 

MICAP 

Period 

Hours 

SOC 

5265 

5412 

5258 

1331661 

SPC 

968 

985 

961 

187049 

SPC 

968 

985 

961 

187049 

TAC 

0 

1 

0 

TAP 

4 

4 

4 

2813 

uss 

6 

6 

6 

7722 

Total 

199294 

204302 

197763 

56236773 

75 


Appendix  C:  List  of  Parts  Used  in  Sample  Data 


NSN 


2840-01-146-9387 


2840-01-178-0436 


2840-01-198-4866 


2995-01-200-7234 


2995-01-324-2084 


3110-01-147-4486 


4710-01-347-8084 


5305-01-319-6514 


5305-01-344-2126 


5306-01-312-8967 


5315-01-238-3341 


5315-01-272-0068 


5340-01-323-8442 


5365-01-218-0912 


1680-01 


2840-01 


2840-01 


2925-01 


4010-00 


5306-00 


5306-01 


5306-01 


5306-01 


5310-01 


5315-01 


5315-01 


5330-00. 


5330-01- 


5331-00- 


5331-00- 


5331-00- 


5331-00- 


5331-00- 


5365-01- 


5365-01- 


5365-01- 


6685-01- 


-213-8558 


-198-4854 


-322-4756 


-190-9352 


-929-0041 


-551-4845 


-173-9537 


-175-3619 


-323-5467 


-177-4992 


-177-5964 


-269-2679 


-020-0203 


-234-6378 


-166-0992 


-166-0993 


-166-1063 


-167-5110 


-167-5143 


-213-7700 


-323-2790 


-323-2794 


-173-0502 


_  Problem  Parts 


_ _  Nomenclature 


SEAL,  METALLIC,  AIRCRAFT 


INUT,  LOCKING,  TURBINE 


LEVER  AND  LINK 


I  MANIFOLD,  FLUID,  AIRCRAFT 


MANIFOLD,  FLUID,  AIRCRAFT 


BEARING,  ROLLING,  CYLINDRICAL 


TUBE  ASSEMBLY,  METAL 


SCREW,  MACHINE 


SCREW,  MACHINE 


BOLT,  MACHINE 


I  PIN,  STRAIGHT,  HEADED 


PIN,  STRAIGHT,  HEADED 


BRACKET,  MOUNTING 


[RING,  SEAL 


_  Non-problem  Parts 


CLAMP,TUBE,DOUBLE  HINGED 


GUTTER,  AUGMENTOR,  FLAMEHOLDER 


CASE,  TURBINE,  AIRCRAFT  GAS  TURBINE 


[IGNITER,  SPARK,  GAS,  TURBINE  ENGINE 


ROPE,  WIRE 


[BOLT,  MACHINE 


BOLT,  MACHINE 


BOLT,  MACHINE 


BOLT,  SHOULDER 


NUT,  SELF-LOCKING,  EXTENDED  WASHER 


PIN,  STRAIGHT,  HEADED 


[PIN,  STRAIGHT,  HEADED 


PACKING,  PREFORMED 


GASKET 


0-RING 


[O-RING 


O-RING 


jO-RlNG 


O-RING 


SPACER,  SLEEVE 


SPACER,  SLEEVE 


[SPACER,  SLEEVE 


TUBE,  SIGHT,  PYROMETER 


Note:  Numbers  in  bold  represent  National  Stock  Numbers 


13 

Q 

I 

a 

CO 

Q 

.a 
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1 

PLI 

1 

3 

2 


SI  i 
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H 

Ph 
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M 
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Q 
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hJ 
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'S 
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Pi 


o 
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1 

m 

CN 

t-H 

1 

1 

130 

1 

- 

1 

B 

1 

72 

00 

o 

f-H 

1 

VS 

t 

-124  1 

-173 

153 

155 

-34 

49 

-199 

281.5 

-39.5 

1 

B 

-364 
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v> 

f-H 

1 

-122 

f-H 

VS 

1 

VO 

o 

o 

1 

B 

cn 

m 

O 

O 

20 

B 

- 

O 

o 

B 

63 

29 

40 

100 

B 

r<i 

125 

1 

125 

1 

138 

69 

69 

434 

63 

260 

00 

Tf 

f-H 

148 

148 

190 

Os 

os 

OS 

fM4 

OS 

230 

VS 

00 

00 

VS 

00 

00 

177 

365 

365 

240 

229 

VO 

O 

f»-H 

106 

106 
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z 

Z 

z 

Z 

z 

z 

a 

B 

Z 

B 

Z 

Z 

z 

z 

B 

Z 

- 

<N 

- 

1 

1 
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m 

- 

<N 

CN 

1 
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1 
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1 

268 

67 

70 

Jn 

135 

CN 

VS 

f-H 

97 

162 

24 
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57 

o 

1 
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49 
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98 

o 

CN 

VO 

99 

m 

OO 

VO 

OS 

CN 

O 

m 

VS 

cn 

<N 
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CN 

vs 

o 

<N 

(N 

f-H 

f-H 

m 

f-H 

CN 

^H 

ON 
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o 

o 
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Os 

VO 

00 

OS 

00 

(Os 

ON 

OS 

Os 

OS 

OS 

os 

Os 

Os 

Os 

c?s 

OS 

(Os 

(Os 

ON 

OS 

Os 

OS 

Os 

OS 

OS 

OS 

OS 

OS 

Os 

Os 

(OS 
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o 
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(Os 

<0s 
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OS 

Os 

OS 

OS 

OS 

OS 

Os 

SO 

OS 
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Os 

(Os 

(Os 

(OS 
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00 

T-H 

1-H 
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f-H 

f-H 

f-H 

f-H 

hH 

f-H 

f-H 

Tt 

WS 

VA 

Sf^ 

r- 

so 

o 

CN 

cs 

CN 

SO 

(N 

r2 
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vs 

m 

VS 

VO 

f-H 

o 

Os 

00 

VO 

vs 

VO 

VO 

00 

VO 

VO 

CN 

VO 

1-H 

CN 

VO 

o 

<N 

o 

f-H 

f-H 

f-H 

o 

f-H 

<N 

CN 

f-H 

CN 

CN 

o 

00 

00 

00 

OS 

o 

r- 

00 

Os 

OS 

o 

vs 

SO 

00 
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OO 

(Os 

os 

Os 

Os 

OS 

OS 

o 

Os 

os 

Os 

Os 

OS 

Os 

o 

OS 

Os 

OS 

Os 

o 

(Os 

Os 

Os 

Os 

Os 

OS 

Os 

<Os 

Os 

Os 

OS 

Os 

OS 

Os 

OS 

OS 

os 

(Os 

1-H 

00 

»oM 

f-H 

r-^ 

vH 

VbH 

f-H 

00 

f-H 

f-H 

f-H 

f-H 

f-H 

HH 

fS 

fS 

_ 
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lample  Data  (continued) 

Recomm  I  Award  date  I  Receipt  I  Actual  I  Actual  I  CLIN  I  DVD  I  Sys  ALT  I  Sys  PLT  I  Qty  I  ALT  I  PLT 
buy  date  date  ALT  PLT  Differ-  Differ- 
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Sample  Data  (continued) _ _ _ _ _ _ _ _ _ 

Recomm  Award  date  Receipt  Actual  Actual  CLIN  DVD  SysALT  SysPLT  Qty  ALT  PLT 

buy  date  date  ALT  PLT  Differ-  Differ¬ 

ence  ence 

5365012180912 


VO 

oo 

1 

62 

1 

-141.5 

90 

279 

OO 

OO 

1 

OO 

OO 

-283.5 

-270.5 

46 

206  1 

B 

B 

B 

-216 

-203 

o 

B 

1 

B 

1 

CN 

1 

-37.5 

Os 

1 

OO 

-79 

o 

oo 

1 

-94 

O 

1 

CN 

1 

29.5 

B 

OO 

CN 

1 

CN 

OO 

1 

OO 

1 

-116 

B 

00 

1 

SO 

1 

021- 

1 

45 

100 

54 

52 

10460 

12022 

593 

593 

236 

94 

24150 

7000 

o 

O 

o 

06 

O 

54 

1  159 

200 

312 

CO 

CN 

rr 

1 

176.5 

353 

353 

250 

250 

301.5 

301.5 

233 

216 

236 

236 

236 

1 

131 

oo 

cn 

68.5 

68.5 

137 

126 

VO 

<N 

126 

VO 

cs 

118.5 

122 

<N 

CN 

CN 

CN 

CN 

122 

122 

1 

122 

CN 

CN 

122 

122 

2 

1 

z 
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B 

B 

:z: 

B 

B 

B 

z 

B 

B 

B 

B 

B 

B 

B 

- 

B 

1 

O 

- 

- 

- 

- 

CN 

f-H 

- 

- 

CN 

m 

- 

CN 

126 

185 

00 

Os 

1 

m 

443 

632 

162 

162 

OO 

cn 

.279 

422 

B 

B 

20 

m 

m 

B 

B 

B 

CN 

- 

185 

m 

OV 

in 

47 

46 

32 

148 

126 

303 

O 

40 

B 

so 

CN 

B 

1992338 

1999022 

1999134 

1994311 

1994332 

1997052 

1997241 

1996179 

1996180 

1996102 

1996115 

1997154 

1998232 

o 

o 

o 

1999147 

1999165 

1  1999167 

1999165 

1999187 

O 

o 

1992213 

1998203 

1999037 

If) 

1994279 

1994298 

1995341 
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Sample  Data  (continued)  _ 
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Sample  Data  (continued) 
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Appendix  F:  Results  of  Hypothesis  Tests 
CASE  1 :  TWO-SAMPLE  T  TESTS  FOR  PPALT  VS  NPPALT 


VARIABLE 

MEAN 

SAMPLE 

SIZE 

S.D. 

S.E. 

PPALT 

NPPALT 

DIFFERENCE 

-48.931 

-36.717 

-12.213 

173 

276 

93.892 

69.603 

7.1385 

4.1896 

NULL  HYPOTHESIS:  DIFFERENCE  =  0 
ALTERNATIVE  HYP:  DIFFERENCE  o  0 


ASSUMPTION 

T 

DF 

P 

95%  Cl  FOR  DIFFERENCE 

EQUAL  VARIANCES 
UNEQUAL  VARIANCES 

1  1 

00  00 

447 

289.4 

0.1153 

0.1369 

(-27.427,  3.0003) 
(-28.504, 4.0777) 

TESTS  FOR  EQUALITY 
OF  VARIANCES 

F 

1.82 

NUMDF 

172 

DEN  DF  P 

275  0.0000 

CASE  1 :  TWO-SAMPLE  T  TESTS  FOR  PPPLT  VS  NPPPLT 


VARIABLE 

MEAN 

SAMPLE 

SIZE 

S.D. 

S.E. 

PPPLT 

NPPPLT 

DIFFERENCE 

-63.631 

-44.646 

-18.985 

141 

246 

142.23 

89.594 

11.978 

5.7123 

NULL  HYPOTHESIS:  DIFFERENCE  =  0 
ALTERNATIVE  HYP:  DIFFERENCE  0 


ASSUMPTION 

T 

DF 

P 

95%  Cl  FOR  DIFFERENCE 

EQUAL  VARIANCES 
UNEQUAL  VARIANCES 

-1.61 

-1.43 

385 

204.9 

0.1082 

0.1500 

(-42.171,4.2015) 
(-45.149, 7.1794) 

TESTS  FOR  EQUALITY 
OF  VARIANCES 

F 

2.52 

NUM 

140 

DF 

DEN  DF  P 

245  0.0000 
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CASE  2:  TWO-SAMPLE  T  TESTS  FOR  DVDALT  VS  STKALT 


VARIABLE 

MEAN 

SAMPLE 

SIZE 

S.D. 

S.E. 

DVDALT 

-82.218 

193 

50.672 

3.6474 

STKALT 

-5.1163 

258 

85.099 

5.2980 

DIFFERENCE 

-77.101 

NULL  HYPOTHESIS:  DIFFERENCE  =  0 
ALTERNATIVE  HYP:  DIFFERENCE  o  0 


ASSUMPTION  T  DF  P  95%  Cl  FOR  DIFFERENCE 


EQUAL  VARIANCES  -11.19  449  0.0000  (-90.644,-63.558) 

UNEQUAL  VARIANCES  -11.99  429.3  0.0000  (-89.744,-64.459) 


F 

NUMDF 

DENDF 

P 

TESTS  FOR  EQUALITY  - 

— 

OF  VARIANCES  2.82 

257 

192 

0.0000 

CASE  2:  TWO-SAMPLE  T  TESTS  FOR  DVDPLT  VS  STKPLT 

SAMPLE 

VARIABLE  MEAN 

SIZE 

S.D. 

S.E. 

DVDPLT  -111.38 

164 

90.043 

7.0312 

STKPLT  -8.6667 

DIFFERENCE  -102.72 

198 

101.83 

7.2364 

NULL  HYPOTHESIS:  DIFFERENCE  =  0 
ALTERNATIVE  HYP:  DIFFERENCE  o  0 

ASSUMPTION  T  DF  P  95%  Cl  FOR  DIFFERENCE 

EQUAL  VARIANCES  -10.06  360  0.0000  (-122.79,-82.645) 

UNEQUAL  VARIANCES  -10.18  358.4  0.0000  (-122.56,-82.875) 

F  NUMDF  DENDF  P 

TESTS  FOR  EQUALITY  .  .  . 

OF  VARIANCES  1.28  197  163  0.0518 
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CASE  3:  TWO-SAMPLE  T  TESTS  FOR  PPDVDALT  VS  PPSTKALT 


VARIABLE 

MEAN 

SAMPLE 

SIZE 

S.D. 

S.E. 

PPDVDALT 

-116.58 

62 

66.054 

8.3889 

PPSTKALT 

-11.050 

111 

85.600 

8.1248 

DIFFERENCE 

-105.53 

NULL  HYPOTHESIS:  DIFFERENCE  =  0 
ALTERNATIVE  HYP:  DIFFERENCE  ^  0 


ASSUMPTION 

T 

DF 

P  95%  Cl  FOR  DIFFERENCE 

EQUAL  VARIANCES 

-8.41 

171 

0.0000 

(-130.31,  -80.749) 

UNEQUAL  VARIANCES 

-9.04 

154.0 

0.0000 

(-128.60,  -82.461) 

F 

NUM 

DF  DEN  DF  P 

TESTS  FOR  EQUALITY 

— 

— 

OF  VARIANCES 

1.68 

no 

61 

0.0139 

CASE  3:  TWO-SAMPLE  T  TESTS  FOR  PPDVDPLT  VS  PPSTKPLT 


VARIABLE 

MEAN 

SAMPLE 

SIZE 

S.D. 

S.E. 

PPDVDPLT 

-173.67 

51 

94.082 

13.174 

PPSTKPLT 

3.3043 

92 

142.32 

14.838 

DIFFERENCE 

-176.97 

NULL  HYPOTHESIS:  DIFFERENCE  =  0 
ALTERNATIVE  HYP:  DIFFERENCE  o  0 


ASSUMPTION 

T 

DF 

P 

95%  Cl  FOR  DIFFERENCE 

EQUAL  VARIANCES 
UNEQUAL  VARIANCES 

-7.96 

-8.92 

141 

136.6 

0.0000 

0.0000 

(-220.91,  -133.03) 
(-216.21,-137.73) 

TESTS  FOR  EQUALITY 
OF  VARIANCES 

F 

2.29 

NUM 

91 

DF 

DENDF  P 

50  0.0009 
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CASE  4:  TWO-SAMPLE  T  TESTS  FORNPPDVDALT  VS  NPPSTKALT 


VARIABLE 

MEAN 

SAMPLE 

SIZE 

S.D. 

S.E. 

NPPDVDALT 

-68.958 

131 

36.275 

3.1693 

NPPSTKALT 

-0.6463 

147 

84.633 

6.9804 

DIFFERENCE 

-68.312 

NULL  HYPOTHESIS:  DIFFERENCE  =  0 
ALTERNATIVE  HYP:  DIFFERENCE  ^  0 


ASSUMPTION 

T 

DF  P 

95%  Cl  FOR  DIFFERENCE 

EQUAL  VARIANCES 

-8.56 

276  0.0000 

(-84.017,  -52.607) 

UNEQUAL  VARIANCES 

-8.91 

202.7  0.0000 

(-83.427,  -53.196) 

F 

NUMDF 

DEN  DF  P 

TESTS  FOR  EQUALITY 

— 

-  - 

OF  VARIANCES 

5.44 

146 

130  0.0000 

CASE  4:  TWO-SAMPLE  T  TESTS  FOR  NPPDVDPLT  VS  NPPSTKPLT 


VARIABLE 

MEAN 

SAMPLE 

SIZE 

S.D. 

S.E. 

NPPDVDPLT 

-85.868 

114 

78.399 

7.3428 

NPPSTKPLT 

-7.2977 

131 

81.415 

7.1132 

DIFFERENCE 

-78.571 

NULL  HYPOTHESIS:  DIFFERENCE  =  0 
ALTERNATIVE  HYP:  DIFFERENCE  o  0 


ASSUMPTION 

T 

DF 

P 

95%  Cl  FOR  DIFFERENCE 

EQUAL  VARIANCES 

-7.67 

243 

0.0000 

(-98.761,-58.380) 

UNEQUAL  VARIANCES 

-7.69 

240.5 

0.0000 

(-98.709,  -58.432) 

F 

NUM 

DF 

DENDF  P 

TESTS  FOR  EQUALITY 

-  - 

OF  VARIANCES 

1.08 

130 

113  0.3410 
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CASE  5:  TWO-SAMPLE  T  TESTS  FOR  PPSTKALT  VS  NPPSTKATT 


VARIABLE 

MEAN 

SAMPLE 

SIZE 

S.D. 

S.E. 

PPSTKALT 

-11.050 

111 

85.600 

8.1248 

NPPSTKALT 

-0.6463 

147 

84.633 

6.9804 

DIFFERENCE 

-10.403 

NULL  HYPOTHESIS:  DIFFERENCE  =  0 
ALTERNATIVE  HYP:  DIFFERENCE  o  0 


ASSUMPTION 

T 

DF  P 

95%  Cl  FOR  DIFFERENCE 

EQUAL  VARIANCES  -0.97 

256  0.3316 

(-31.464, 10.657) 

UNEQUAL  VARIANCES  -0.97 

235.6  0.3344 

(-31.506, 10.699) 

F 

NUMDF 

DENDF 

P 

TESTS  FOR  EQUALITY  - 

OF  VARIANCES 

1.02 

no 

146 

0.4461 

CASE  5:  TWO-SAMPLE  T  TESTS  FOR  PPSTKPLT  VS  NPPSTKPLT 

SAMPLE 

VARIABLE 

MEAN 

SIZE 

S.D. 

S.E. 

PPSTKPLT 

3.3043 

92 

142.32 

14.838 

NPPSTKPLT 

-7.2977 

131 

81.415 

7.1132 

DIFFERENCE 

10.602 

NULL  HYPOTHESIS:  DIFFERENCE  =  0 
ALTERNATIVE  HYP:  DIFFERENCE  o  0 

ASSUMPTION  T  DF  P  95%  Cl  FOR  DIFFERENCE 


EQUAL  VARIANCES  0.70  221  0.4819  (-19.055,40.260) 

UNEQUAL  VARIANCES  0.64  132.7  0.5279  (-21.946,43.150) 

F  NUMDF  DENDF  P 

TESTS  FOR  EQUALITY  — .  .  . 

OF  VARIANCES  3.06  91  130  0.0000 
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CASE  6:  TWO-SAMPLE  T  TESTS  FOR  PPDVDALT  VS  NPPDVDALT 


VARIABLE 

MEAN 

SAMPLE 

SIZE 

S.D. 

S.E. 

PPDVDALT 

-116.58 

62 

66.054 

8.3889 

NPPDVDALT 

-68.958 

131 

36.275 

3.1693 

DIFFERENCE 

-47.623 

NULL  HYPOTHESIS:  DIFFERENCE  =  0 
ALTERNATIVE  HYP:  DIFFERENCE  o  0 


ASSUMPTION 

T 

DF 

P 

95%  Cl  FOR  DIFFERENCE 

EQUAL  VARIANCES 
UNEQUAL  VARIANCES 

-6.46 

-5.31 

191 

78.9 

0.0000 

0.0000 

(-62.170,  -33.075) 
(-65.472,  -29.773) 

F 

NUMDF 

DEN  DF  P 

TESTS  FOR  EQUALITY 
OF  VARIANCES 

3.32 

61 

130  0.0000 

CASE  6:  TWO-SAMPLE  T  TESTS  FOR  PPDVDPLT  VS  NPPDVDPLT 


VARIABLE 

MEAN 

SAMPLE 

SIZE 

S.D. 

S.E. 

PPDVDPLT 

-173.67 

51 

94.082 

13.174 

NPPDVDPLT 

-85.868 

114 

78.399 

7.3428 

DIFFERENCE 

-87.798 

NULL  HYPOTHESIS:  DIFFERENCE  =  0 
ALTERNATIVE  HYP:  DIFFERENCE  o  0 


ASSUMPTION 

T 

DF 

P 

95%  Cl  FOR  DIFFERENCE 

EQUAL  VARIANCES 

-6.24 

163 

0.0000 

(-115.58,-60.014) 

UNEQUAL  VARIANCES 

-5.82 

82.4 

0.0000 

(-117.80,  -57.797) 

F 

NUM 

DF 

DEN  DF  P 

TESTS  FOREQUALITY 

OF  VARIANCES 

1.44 

50 

113  0.0574 
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